-- Logs begin at Tue 2022-08-09 01:14:10 UTC, end at Tue 2022-08-09 02:58:04 UTC. -- Aug 09 02:32:06.787978 dv-cinder-852461-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 09 02:32:06.797215 dv-cinder-852461-1-iscsi devstack@n-api.service[109912]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 09 02:32:06.799358 dv-cinder-852461-1-iscsi devstack@n-api.service[109912]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 9 02:32:06 2022] *** Aug 09 02:32:06.799358 dv-cinder-852461-1-iscsi devstack@n-api.service[109912]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 09 02:32:06.799358 dv-cinder-852461-1-iscsi devstack@n-api.service[109912]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 09 02:32:06.799358 dv-cinder-852461-1-iscsi devstack@n-api.service[109912]: nodename: dv-cinder-852461-1-iscsi Aug 09 02:32:06.799358 dv-cinder-852461-1-iscsi devstack@n-api.service[109912]: machine: x86_64 Aug 09 02:32:06.799358 dv-cinder-852461-1-iscsi devstack@n-api.service[109912]: clock source: unix Aug 09 02:32:06.799358 dv-cinder-852461-1-iscsi devstack@n-api.service[109912]: pcre jit disabled Aug 09 02:32:06.799358 dv-cinder-852461-1-iscsi devstack@n-api.service[109912]: detected number of CPU cores: 4 Aug 09 02:32:06.799358 dv-cinder-852461-1-iscsi devstack@n-api.service[109912]: current working directory: / Aug 09 02:32:06.799358 dv-cinder-852461-1-iscsi devstack@n-api.service[109912]: detected binary path: /usr/bin/uwsgi-core Aug 09 02:32:06.799358 dv-cinder-852461-1-iscsi devstack@n-api.service[109912]: your processes number limit is 47680 Aug 09 02:32:06.799358 dv-cinder-852461-1-iscsi devstack@n-api.service[109912]: your memory page size is 4096 bytes Aug 09 02:32:06.799358 dv-cinder-852461-1-iscsi devstack@n-api.service[109912]: detected max file descriptor number: 2048 Aug 09 02:32:06.799358 dv-cinder-852461-1-iscsi devstack@n-api.service[109912]: lock engine: pthread robust mutexes Aug 09 02:32:06.801097 dv-cinder-852461-1-iscsi devstack@n-api.service[109912]: thunder lock: enabled Aug 09 02:32:06.801097 dv-cinder-852461-1-iscsi devstack@n-api.service[109912]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 09 02:32:06.801097 dv-cinder-852461-1-iscsi devstack@n-api.service[109912]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 09 02:32:06.840414 dv-cinder-852461-1-iscsi devstack@n-api.service[109912]: Python main interpreter initialized at 0x55cd549ab9c0 Aug 09 02:32:06.840414 dv-cinder-852461-1-iscsi devstack@n-api.service[109912]: python threads support enabled Aug 09 02:32:06.840414 dv-cinder-852461-1-iscsi devstack@n-api.service[109912]: your server socket listen backlog is limited to 100 connections Aug 09 02:32:06.840414 dv-cinder-852461-1-iscsi devstack@n-api.service[109912]: your mercy for graceful operations on workers is 90 seconds Aug 09 02:32:06.840877 dv-cinder-852461-1-iscsi devstack@n-api.service[109912]: mapped 403077 bytes (393 KB) for 2 cores Aug 09 02:32:06.840877 dv-cinder-852461-1-iscsi devstack@n-api.service[109912]: *** Operational MODE: preforking *** Aug 09 02:32:06.841091 dv-cinder-852461-1-iscsi devstack@n-api.service[109912]: *** uWSGI is running in multiple interpreter mode *** Aug 09 02:32:06.841091 dv-cinder-852461-1-iscsi devstack@n-api.service[109912]: spawned uWSGI master process (pid: 109912) Aug 09 02:32:06.841393 dv-cinder-852461-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 09 02:32:06.841938 dv-cinder-852461-1-iscsi devstack@n-api.service[109912]: spawned uWSGI worker 1 (pid: 109913, cores: 1) Aug 09 02:32:06.842889 dv-cinder-852461-1-iscsi devstack@n-api.service[109912]: spawned uWSGI worker 2 (pid: 109914, cores: 1) Aug 09 02:32:06.842889 dv-cinder-852461-1-iscsi devstack@n-api.service[109912]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 09 02:32:07.490344 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 09 02:32:07.490979 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 09 02:32:08.554673 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 02:32:08.554673 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: from cryptography.utils import int_from_bytes Aug 09 02:32:08.555438 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 02:32:08.555438 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: from cryptography.utils import int_from_bytes Aug 09 02:32:08.555438 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 02:32:08.555438 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: from cryptography.utils import int_from_bytes Aug 09 02:32:08.555917 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 02:32:08.555917 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: from cryptography.utils import int_from_bytes Aug 09 02:32:10.980075 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 09 02:32:10.980798 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 09 02:32:10.980798 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 09 02:32:10.981074 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 09 02:32:10.981441 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 09 02:32:10.981538 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 09 02:32:10.981608 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 09 02:32:10.981762 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.981911 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 09 02:32:10.982074 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.982260 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 09 02:32:10.982390 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.982497 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 09 02:32:10.982713 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.982883 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.982994 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.983224 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.983383 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.983518 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.983633 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.983857 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.983998 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.984151 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.984241 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.984463 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.984595 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.984767 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.984898 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.985086 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852461-1-iscsi {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.985229 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.985408 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.985562 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.985657 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.985739 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.985921 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.986058 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.986271 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852461-1-iscsi {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.986383 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.986570 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.986665 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.986876 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.986972 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.987170 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.987265 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.987489 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.987665 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.987777 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.988085 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.988197 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.988383 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.988489 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.988696 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.988878 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.988997 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.989183 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.989292 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.989481 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.989588 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.989784 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.989880 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.990115 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.990243 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.990452 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.990556 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.990756 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.990844 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.991071 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.991174 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852461-1-iscsi {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.991373 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.991467 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.991693 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.991789 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.991998 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.992082 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.992385 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852461-1-iscsi {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.992493 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.992695 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.992788 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.992993 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.993094 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.993297 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.993384 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.993612 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.993704 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.993917 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.994020 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.994259 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.994391 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.994580 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.994671 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.994885 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.994983 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.995202 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.995342 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.995495 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.995598 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.995797 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.995889 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.996100 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.996205 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.996414 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.996503 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.996712 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.996801 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.997007 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.997104 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.997302 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.997397 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.997602 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.997700 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.997917 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.998013 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.998254 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.998356 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.998534 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.998621 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.998804 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.998905 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.999047 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.999145 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.999358 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.999457 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.999678 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.999777 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:10.999970 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.000063 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.000213 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.000300 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.000529 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.000617 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.000845 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.000958 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.001143 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.001245 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.001440 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.001542 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.001736 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.001831 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.002031 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.002142 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.002364 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.002513 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.002653 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.002788 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.002955 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.003105 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.003238 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.003383 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.003553 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.003694 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.003842 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.003982 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.004162 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.004310 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.004449 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.004533 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.004770 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.004863 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.005077 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.005177 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.005375 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.005470 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.005683 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.005769 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.005990 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.006078 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.006313 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.006415 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.006618 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.006705 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.006919 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.007008 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.007229 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.007316 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.007532 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.007618 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.007834 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.007922 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.008073 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.008159 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.008365 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.008452 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.008660 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.008748 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.008970 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.009057 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.009267 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.009362 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.009563 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.009656 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.009856 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.009949 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.010165 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.010268 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.010465 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.010552 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.010762 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.010861 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.011059 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.011154 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.011354 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.011441 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.011649 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.011741 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.011946 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.012040 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.012240 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.012333 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.012537 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.012622 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.012890 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.012985 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.013193 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.013280 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.013498 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.013597 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.013798 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.013894 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.014093 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.014196 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.014414 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.014568 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.014712 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.014810 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.015025 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.015110 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.015319 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.015404 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.015617 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.015707 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.015916 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.016009 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.016214 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.016301 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.016517 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.016616 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.016815 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.016900 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.017112 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.017198 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.017411 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.017507 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.017710 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.017803 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.018000 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.018087 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.018322 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.018412 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.018626 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.018712 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.018920 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.019005 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.019216 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.019315 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.019510 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.019604 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.019802 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.019902 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.020095 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.020183 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.020388 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.020477 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.020680 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.020780 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.020974 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.021060 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.021259 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.021347 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.021554 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.021652 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.021853 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.021941 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.022169 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.022260 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.022461 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.022558 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.022755 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.022841 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.023065 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.023151 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.023363 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.023470 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.023666 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.023756 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.023968 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.024062 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.024284 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:32:11.024378 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.024627 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.024715 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.024932 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.025026 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.025244 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.025338 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.025548 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.025643 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.025856 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.025955 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.026194 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.026297 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.026506 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.026593 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.026812 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.026905 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.027113 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.027206 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.027423 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.027517 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.027729 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.027833 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.028037 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.028134 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.028344 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.028985 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.029088 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.029180 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.029262 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.029343 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.029482 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.029567 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.029655 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.029745 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.029892 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.029982 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.030225 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.030316 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.030530 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.030637 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.030884 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.031032 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.031190 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.031336 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.031515 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.031675 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.031815 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.031908 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.032139 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.032235 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.032464 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.032551 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.032766 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.032854 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.033071 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.033216 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.033370 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.033518 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.033668 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.033783 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.033969 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.034057 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.034296 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.034395 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.034601 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.034730 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.034907 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.035050 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.035205 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.035294 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.035506 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.035596 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.035813 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.035989 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.036148 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.036290 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.036434 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.036579 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.036715 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.036865 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.037006 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.037147 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.037289 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.037409 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.037590 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.037689 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.037900 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.037987 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.038229 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.038324 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.038542 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.038650 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.038849 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.038944 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.039156 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.039244 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.039453 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.039549 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.039748 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.039835 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.040043 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.040138 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.040344 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.040432 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.040645 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.040744 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.040943 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.041029 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.041249 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.041371 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.041548 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.041636 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.041846 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.041941 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.042144 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.042246 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.042464 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.042561 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.042768 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.042855 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.043068 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.043156 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.043362 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.043450 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.043661 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.043756 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.043964 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.044050 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.044296 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.044392 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.044608 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.044703 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.044905 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.044995 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.045199 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.045286 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.045649 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.045764 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.045887 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.046017 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.046110 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.046255 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.046428 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.046530 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.046736 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.046824 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.047040 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.047141 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.047348 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.047436 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.047653 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.047747 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.047960 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.048048 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.048279 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.048377 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.048571 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.048659 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.048879 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.048972 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.049192 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.049279 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.049503 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.049591 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.049798 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.049893 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.050107 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.050257 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.050424 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.050519 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.050719 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.050820 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.051013 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.051101 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.051313 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.051399 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.051606 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.051710 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.051901 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.051989 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.052197 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.052284 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.052490 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.052584 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.052783 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.052879 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.053080 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.053166 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.053378 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.053473 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.053668 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.053761 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.053964 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.054052 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.054284 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.054378 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.054596 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.054682 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.054893 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.054979 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.055191 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.055282 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.055488 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.055574 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.055824 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.055917 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.056124 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.056213 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.056435 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.056529 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.056801 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.056908 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.057035 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.057123 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.057336 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.057423 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.057637 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.057733 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.057939 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.058034 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.058269 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.058372 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.058573 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.058670 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.058879 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.058964 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.059175 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.059261 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.059489 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.059588 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.059877 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.059975 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.060192 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.060286 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.060491 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.060587 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.060796 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.060883 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.061116 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.061200 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.061432 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.061535 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.061733 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.061824 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.062042 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.062130 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.062365 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.062453 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.062670 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.062770 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.062971 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.063058 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.063270 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.063358 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.063569 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.063666 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.063871 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.063959 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.064179 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.064274 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.064478 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.064566 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.064781 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.064868 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.065080 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.065176 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.065391 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.065477 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.065686 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.065781 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.065993 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.066117 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.066310 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.066399 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.066619 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.066719 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.066927 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.067025 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.067238 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.067332 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.067534 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.067633 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.067835 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.067922 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.068149 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.068244 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.068450 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.068546 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.068752 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.068840 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.069053 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.069141 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.069349 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.069444 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.069642 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.069730 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.069943 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.070038 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.070269 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.070359 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.070571 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.070658 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.070869 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.070966 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.071166 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.071264 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.071469 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.071569 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.071769 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.071863 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.072063 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.072151 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.072358 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.072444 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.072655 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.072748 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.072959 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.073046 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.073258 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.073345 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.073555 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.073649 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.073860 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.073955 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.074188 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.074291 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.074464 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.074565 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.074776 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.074864 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.075074 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.075204 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.075390 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.075487 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.075684 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.075779 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.075976 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.076063 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.076303 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.076406 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.076604 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.076690 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.076897 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.077004 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.077196 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.077293 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.077500 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.077588 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.077800 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.077886 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.078102 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.078208 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.078424 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.078510 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.078723 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.078810 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.079029 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.079117 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.079327 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.079413 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.079626 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.079721 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.079924 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.080013 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.080222 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.080308 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.080522 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.080627 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.080819 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.080920 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.081119 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.081209 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.081417 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.081511 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.081717 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.081813 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.082016 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.082218 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.082352 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.082499 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.082640 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.082781 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.082912 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.083043 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.083224 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.083463 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.083606 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.083790 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.083925 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.084097 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.084240 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.084407 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.084658 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.084801 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.084986 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.085119 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.085324 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.085464 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.085596 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.085726 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.085900 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.086035 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.086245 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.086395 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.086555 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.086644 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.086850 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.086938 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.087146 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.087255 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.087450 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.087558 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.087742 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.087831 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.088034 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.088121 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.088326 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.088415 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.088624 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.088718 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.088915 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.089010 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.089208 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.089296 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.089501 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.089592 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.089794 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.089883 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.090090 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.090230 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.090406 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.090492 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.090705 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.090813 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.091064 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.091162 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.091377 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.091462 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.091674 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.091772 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.091968 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.092056 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.092260 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.092347 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.092553 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.092649 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.092867 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.092953 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.093164 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.093250 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.093458 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.093553 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.093757 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.093851 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.094097 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.094205 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.094424 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.094513 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.094719 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.094813 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.095033 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.095127 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.095329 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.095417 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.095623 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.095718 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.095920 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.096007 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.096221 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.096310 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.096526 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.096669 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.096804 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.096939 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.097105 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.097236 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.097402 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.097613 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.097744 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.097888 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.098024 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.098188 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.098320 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.098456 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.098588 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.098731 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.098862 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.098993 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.099153 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.099297 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.099451 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.099595 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.099735 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.099868 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.100024 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.100158 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.100324 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.100473 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.100612 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.100742 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.100900 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.101038 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.101194 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.101328 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.101483 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.101619 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.101785 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.101919 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.102069 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.102251 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.102381 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.102523 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.103012 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.103151 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.103318 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.103462 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.103617 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.103759 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.103912 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.104045 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.104191 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.104329 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.104495 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.104629 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.104795 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.104936 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.105075 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.105216 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.105378 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.105519 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.105674 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.105771 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.105966 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.106063 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.106284 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.106375 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.106623 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.106797 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.106922 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.107017 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.107213 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.107300 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.107515 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.107634 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.107806 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.107897 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.108099 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.108195 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.108395 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.108484 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.108694 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.108781 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.108986 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.109073 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.109279 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.109368 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.109570 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.109657 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.109862 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.109951 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.110194 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.110286 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.110474 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.110561 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.110769 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.110869 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.111063 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.111151 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.111356 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.111456 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.111651 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.111747 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.111963 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.112050 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.112261 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.112402 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.112557 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.112699 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.112854 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.112999 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.113178 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.113310 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.113473 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.113617 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.113770 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.113901 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.114069 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.114226 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.114394 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.114537 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.114678 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.114821 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.114977 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.115111 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.115277 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.115411 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.115583 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.115702 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.115879 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.115981 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.116188 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.116279 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.116472 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.116577 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.116776 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.116869 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.117072 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.117158 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.117370 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.117459 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.117679 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.117780 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.117986 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.118079 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.118300 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.118388 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.118601 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.118688 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.118901 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.118990 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.119200 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.119294 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.119499 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.119594 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.119795 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.119882 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.120093 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.120188 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.120393 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.120488 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.120691 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.120777 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.120990 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.121084 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.121289 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.121388 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.121586 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.121674 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.121885 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.121972 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.122242 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.122415 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.122555 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.122703 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.122855 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.122984 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.123126 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.123258 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.123411 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.123548 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.123706 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.123848 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.123991 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.124122 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.124280 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.124431 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.124562 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.124694 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.124923 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.125057 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.125224 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.125358 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.125530 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.125688 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.125820 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.125956 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.126119 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.126303 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.126451 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.126593 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.126744 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.126872 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.127034 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.127170 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.127329 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.127471 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.127727 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.127877 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.128033 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.128174 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.128338 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.128497 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.128628 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.128766 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.128921 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.129056 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.129215 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.129357 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.129515 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.129651 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.129831 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.129966 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.130127 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.130292 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.130445 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.130578 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.130739 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.130876 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.131052 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.131144 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.131345 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.131441 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.131657 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.131744 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.131957 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.132045 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.132273 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.132395 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.132574 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.132665 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.132890 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.133022 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.133295 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.133383 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.133601 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.133702 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.133902 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.133989 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.134234 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.134337 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.134552 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.134714 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.134849 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.134936 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.135153 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.135240 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.135454 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.135571 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.135768 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.135862 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.136085 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.136185 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.136391 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.136479 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.136695 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.136793 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.136998 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.137089 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.137305 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.137393 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.137614 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.137714 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.137939 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.138067 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.138274 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.138364 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.138610 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.138699 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.138930 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.139026 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.139239 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.139335 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.139557 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.139646 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.139873 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.139961 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.140169 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.140257 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.140468 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.140557 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.140766 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.140863 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.141063 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.141160 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.141356 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.141445 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.141669 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.141766 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.141965 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.142063 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.142288 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.142383 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.142592 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.142688 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.142892 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.142989 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.143186 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.143273 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.143481 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.143578 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.143794 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.143892 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.144089 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.144177 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.144389 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.144475 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.144689 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.144855 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.144999 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.145095 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.145294 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.145381 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.145592 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.145687 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.145901 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.145987 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.146230 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.146335 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.146529 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.146619 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.146825 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.146913 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.147122 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.147211 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.147453 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.147543 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.147747 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.147836 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.148058 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.148145 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.148370 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.148457 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.148691 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.148779 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.148992 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.149086 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.149307 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.149396 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.149617 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.149713 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.149922 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.150019 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.150257 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.150347 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.150573 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.150659 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.150867 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.150970 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.151161 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.151249 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.151458 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.151546 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.151749 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.151839 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.152040 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.152135 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.152331 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.152419 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.152627 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.152716 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.152920 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.153008 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.153211 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.153299 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.153589 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.153685 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.153899 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.153987 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.154214 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.154349 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.154516 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.154606 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.154816 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.154912 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.155108 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.155204 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.155402 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.155499 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.155697 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.155788 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.156007 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.156102 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.156306 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.156402 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.156607 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.156696 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.156907 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.157006 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.157218 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.157308 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.157526 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.157617 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.157831 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.157929 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.158137 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.158287 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.158462 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.158549 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.158767 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.158856 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.159072 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.159173 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.159376 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.159464 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.159676 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.159766 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.159981 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.160069 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.160286 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.160374 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.160594 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.160682 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.160898 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.161097 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.161226 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.161416 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.161518 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.161721 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.161810 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.162024 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.162322 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.162425 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.162644 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.162772 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.162947 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.163035 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.163248 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.163345 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.163547 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.163636 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.163848 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.163935 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.164149 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.164247 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.164455 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.164543 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.164763 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.164851 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.165071 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.165159 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.165377 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.165465 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.165684 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.165772 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.165988 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.166118 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.166320 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.166410 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.166622 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.166711 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.166956 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.167044 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.167260 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.167355 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.167559 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.167656 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.167859 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.167954 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.168163 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.168250 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.168469 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.168568 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.168767 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.168855 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.169089 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.169185 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.169392 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.169481 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.169693 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.169789 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.169993 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.170081 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.170316 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.170408 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.170616 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.170716 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.170916 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.171004 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.171220 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.171316 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.171523 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.171612 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.171830 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.171928 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.172129 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.172225 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.172430 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.172518 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.172734 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.172933 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.173056 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.173238 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.173364 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.173546 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.173670 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.173868 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.173979 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.174207 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.174518 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.174606 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.174824 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.174912 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.175131 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.175226 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.175446 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.175541 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.175743 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.175831 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.176038 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.176125 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.176338 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.176434 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.176638 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.176728 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.176932 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.177022 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.177240 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.177369 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.177538 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.177626 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.177830 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.177918 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.178126 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.178242 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.178446 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.178533 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.178754 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.178965 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.179060 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.179305 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.179394 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.179614 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.179702 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.179935 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.180151 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.180249 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.180512 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.180638 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.180806 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.180907 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.181166 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.181271 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.181424 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.181511 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.181717 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.181805 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.182024 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.182113 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.182346 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.182436 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.182641 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.182728 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.182936 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.183033 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.183237 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.183326 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.183536 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.183623 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.183830 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.183919 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.184127 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.184213 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.184418 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.184506 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.184787 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.184884 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.185084 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.185171 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.185383 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.185479 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.185677 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.185764 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.185976 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.186068 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.186300 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.186411 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.186598 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.186694 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.186892 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.186980 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.187184 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.187281 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.187483 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.187578 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.187796 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.187892 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.188071 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.188167 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.188362 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.188453 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.188664 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.188755 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.188954 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.189050 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.189255 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.189344 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.189551 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.189654 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.189850 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.189940 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.190142 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.190248 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.190468 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.190555 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.190766 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.190856 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.191077 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.191164 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.191376 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.191463 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.191683 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.191773 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.191985 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.192074 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.192314 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.192410 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.192618 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.192705 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.192927 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.193140 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.193239 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.193466 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.193556 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.193776 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.193872 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.194099 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.194408 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.194510 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.194724 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.194818 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.195019 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.195109 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.195315 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.195412 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.195628 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.195723 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.195934 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.196030 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.196240 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.196372 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.196537 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.196624 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.196834 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.196921 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.197132 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.197229 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.197430 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.197560 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.197731 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.197820 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.198032 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.198121 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.198355 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.198444 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.198653 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.198754 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.198951 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.199047 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.199248 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.199336 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.199545 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.199641 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.199846 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.199932 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.200145 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.200233 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.200488 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.200588 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.200792 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.200880 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.201096 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.201184 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.201400 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.201539 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.201707 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.201796 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.202005 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.202099 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.202330 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.202428 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.202632 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.202721 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.202932 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.203020 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.203238 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.203329 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.203544 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.203638 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.203847 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.203936 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.204141 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.204229 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.204448 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.204535 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.204779 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.204877 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.205088 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.205183 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.205387 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.205475 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.205713 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.205808 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.206030 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.206118 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.206367 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.206500 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.206669 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.206771 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.206981 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.207070 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.207283 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.207373 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.207599 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.207688 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.207913 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.208008 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.208230 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.208318 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.208536 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.208632 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.208832 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.208921 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.209127 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.209215 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.209420 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.209509 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.209718 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.209806 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.210026 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.210123 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.210349 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.210438 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.210642 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.210741 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.210937 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.211034 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.211236 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.211325 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.211529 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.211617 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.211822 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.211918 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.212114 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.212201 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.212410 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.212533 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.212709 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.212812 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.213000 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.213087 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.213293 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.213389 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.213587 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.213676 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.213879 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.213968 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.214187 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.214279 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.214483 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.214574 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.214780 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.214870 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.215071 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.215166 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.215363 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.215451 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.215652 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.215738 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.216005 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.216093 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.216305 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.216400 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.216606 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.216701 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.216905 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.217003 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.217205 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.217302 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.217502 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.217590 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.217816 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.217921 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.218129 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.218298 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.218451 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.218540 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.218763 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.218865 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.219068 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.219155 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.219368 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.219454 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.219667 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.219756 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.219981 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.220076 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.220277 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.220364 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.220577 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.220678 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.220876 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.220971 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.221175 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.221264 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.221473 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.221562 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.221771 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.221862 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.222080 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.222187 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.222414 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.222505 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.222707 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.222794 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.223010 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.223109 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.223315 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.223404 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.223625 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.223713 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.223925 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.224020 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.224226 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.224320 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.224542 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.224638 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.224841 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.224940 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.225140 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.225229 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.225438 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.225532 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.225738 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.225827 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.226042 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.226130 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.226370 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.226461 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.226671 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.226767 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.226969 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.227057 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.227272 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.227359 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.227930 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.228064 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.228236 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.228324 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.228541 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.228638 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.228838 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.228933 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.229149 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.229236 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.229461 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.229628 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.229779 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.229874 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.230132 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.230282 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.230430 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.230532 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.230747 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.230841 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.231071 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.231166 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.231376 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.231473 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.231699 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.231795 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.231937 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 09 02:32:11.232063 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.232375 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.232683 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.232983 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:32:11.233220 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 09 02:32:11.387296 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: INFO dbcounter [None req-a03c2361-69ef-4f33-a4d2-7ce1717729f6 None None] Registered counter for database nova_api Aug 09 02:32:11.391251 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: INFO dbcounter [None req-763dd901-f1ca-4d45-9a6c-25c884b36db4 None None] Registered counter for database nova_api Aug 09 02:32:11.410958 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG oslo_db.sqlalchemy.engines [None req-a03c2361-69ef-4f33-a4d2-7ce1717729f6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109914) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 02:32:11.412798 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG oslo_db.sqlalchemy.engines [None req-763dd901-f1ca-4d45-9a6c-25c884b36db4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109913) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 02:32:11.417745 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG dbcounter [-] [109914] Writer thread running {{(pid=109914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 02:32:11.419449 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG dbcounter [-] [109913] Writer thread running {{(pid=109913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 02:32:11.473805 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.context [None req-a03c2361-69ef-4f33-a4d2-7ce1717729f6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6567d965-9880-4701-afff-5a3d599c8537(cell1) {{(pid=109914) load_cells /opt/stack/nova/nova/context.py:464}} Aug 09 02:32:11.474557 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.context [None req-763dd901-f1ca-4d45-9a6c-25c884b36db4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6567d965-9880-4701-afff-5a3d599c8537(cell1) {{(pid=109913) load_cells /opt/stack/nova/nova/context.py:464}} Aug 09 02:32:11.478021 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG oslo_concurrency.lockutils [None req-a03c2361-69ef-4f33-a4d2-7ce1717729f6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=109914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:32:11.478512 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG oslo_concurrency.lockutils [None req-a03c2361-69ef-4f33-a4d2-7ce1717729f6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:32:11.478715 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG oslo_concurrency.lockutils [None req-763dd901-f1ca-4d45-9a6c-25c884b36db4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=109913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:32:11.479194 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG oslo_concurrency.lockutils [None req-763dd901-f1ca-4d45-9a6c-25c884b36db4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:32:11.480067 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG oslo_concurrency.lockutils [None req-a03c2361-69ef-4f33-a4d2-7ce1717729f6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:32:11.480837 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG oslo_concurrency.lockutils [None req-a03c2361-69ef-4f33-a4d2-7ce1717729f6 None None] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=109914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:32:11.480967 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG oslo_concurrency.lockutils [None req-763dd901-f1ca-4d45-9a6c-25c884b36db4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:32:11.481180 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG oslo_concurrency.lockutils [None req-a03c2361-69ef-4f33-a4d2-7ce1717729f6 None None] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:32:11.481484 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG oslo_concurrency.lockutils [None req-763dd901-f1ca-4d45-9a6c-25c884b36db4 None None] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=109913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:32:11.482021 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG oslo_concurrency.lockutils [None req-763dd901-f1ca-4d45-9a6c-25c884b36db4 None None] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:32:11.483259 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG oslo_concurrency.lockutils [None req-a03c2361-69ef-4f33-a4d2-7ce1717729f6 None None] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:32:11.484042 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG oslo_concurrency.lockutils [None req-763dd901-f1ca-4d45-9a6c-25c884b36db4 None None] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:32:11.485218 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: INFO dbcounter [None req-a03c2361-69ef-4f33-a4d2-7ce1717729f6 None None] Registered counter for database nova_cell0 Aug 09 02:32:11.486026 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: INFO dbcounter [None req-763dd901-f1ca-4d45-9a6c-25c884b36db4 None None] Registered counter for database nova_cell0 Aug 09 02:32:11.490609 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: INFO dbcounter [None req-a03c2361-69ef-4f33-a4d2-7ce1717729f6 None None] Registered counter for database nova_cell1 Aug 09 02:32:11.491535 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: INFO dbcounter [None req-763dd901-f1ca-4d45-9a6c-25c884b36db4 None None] Registered counter for database nova_cell1 Aug 09 02:32:11.499385 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG oslo_db.sqlalchemy.engines [None req-a03c2361-69ef-4f33-a4d2-7ce1717729f6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109914) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 02:32:11.503161 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG oslo_db.sqlalchemy.engines [None req-a03c2361-69ef-4f33-a4d2-7ce1717729f6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109914) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 02:32:11.505436 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG oslo_db.sqlalchemy.engines [None req-763dd901-f1ca-4d45-9a6c-25c884b36db4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109913) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 02:32:11.507383 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG oslo_db.sqlalchemy.engines [None req-763dd901-f1ca-4d45-9a6c-25c884b36db4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109913) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 02:32:11.509061 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG dbcounter [-] [109914] Writer thread running {{(pid=109914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 02:32:11.513083 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG dbcounter [-] [109913] Writer thread running {{(pid=109913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 02:32:11.515769 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG dbcounter [-] [109913] Writer thread running {{(pid=109913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 02:32:11.643554 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG dbcounter [-] [109914] Writer thread running {{(pid=109914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 02:32:11.653727 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: INFO dbcounter [None req-a03c2361-69ef-4f33-a4d2-7ce1717729f6 None None] Registered counter for database nova_cell0 Aug 09 02:32:11.655367 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: INFO dbcounter [None req-763dd901-f1ca-4d45-9a6c-25c884b36db4 None None] Registered counter for database nova_cell0 Aug 09 02:32:11.665575 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG oslo_db.sqlalchemy.engines [None req-a03c2361-69ef-4f33-a4d2-7ce1717729f6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109914) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 02:32:11.669683 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG oslo_db.sqlalchemy.engines [None req-763dd901-f1ca-4d45-9a6c-25c884b36db4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109913) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 02:32:11.671167 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG dbcounter [-] [109914] Writer thread running {{(pid=109914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 02:32:11.674613 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG dbcounter [-] [109913] Writer thread running {{(pid=109913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 02:32:12.002856 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: WARNING keystonemiddleware.auth_token [None req-a03c2361-69ef-4f33-a4d2-7ce1717729f6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 02:32:12.006718 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: WARNING keystonemiddleware.auth_token [None req-763dd901-f1ca-4d45-9a6c-25c884b36db4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 02:32:12.010060 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: WARNING keystonemiddleware.auth_token [None req-a03c2361-69ef-4f33-a4d2-7ce1717729f6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 02:32:12.013945 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: WARNING keystonemiddleware.auth_token [None req-763dd901-f1ca-4d45-9a6c-25c884b36db4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 02:32:12.350760 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: WARNING keystonemiddleware.auth_token [None req-a03c2361-69ef-4f33-a4d2-7ce1717729f6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 02:32:12.357231 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: WARNING keystonemiddleware.auth_token [None req-a03c2361-69ef-4f33-a4d2-7ce1717729f6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 02:32:12.362493 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cd549ab9c0 pid: 109914 (default app) Aug 09 02:32:12.362901 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: WARNING keystonemiddleware.auth_token [None req-763dd901-f1ca-4d45-9a6c-25c884b36db4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 02:32:12.364534 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi [None req-a03c2361-69ef-4f33-a4d2-7ce1717729f6 None None] Calling method '>' {{(pid=109914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:32:12.365723 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: INFO nova.api.openstack.requestlog [None req-a03c2361-69ef-4f33-a4d2-7ce1717729f6 None None] 10.222.0.20 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001719 Aug 09 02:32:12.366125 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: [pid: 109914|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 788 bytes} [Tue Aug 9 02:32:12 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:32:12.368892 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: WARNING keystonemiddleware.auth_token [None req-763dd901-f1ca-4d45-9a6c-25c884b36db4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 02:32:12.374252 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cd549ab9c0 pid: 109913 (default app) Aug 09 02:33:27.993959 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi [None req-a03c2361-69ef-4f33-a4d2-7ce1717729f6 None None] Calling method '>' {{(pid=109914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:33:27.995049 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: INFO nova.api.openstack.requestlog [None req-a03c2361-69ef-4f33-a4d2-7ce1717729f6 None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001551 Aug 09 02:33:27.995437 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: [pid: 109914|app: 0|req: 2/2] 10.222.0.20 () {54 vars in 931 bytes} [Tue Aug 9 02:33:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:33:28.007650 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG dbcounter [-] [109913] Writing DB stats nova_api:SELECT=3 {{(pid=109913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:33:28.008797 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG dbcounter [-] [109913] Writing DB stats nova_cell1:SELECT=3 {{(pid=109913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:33:28.009825 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG dbcounter [-] [109913] Writing DB stats nova_cell0:SELECT=3 {{(pid=109913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:33:28.011004 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG dbcounter [-] [109913] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:33:28.857693 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi [None req-ecc84a44-3184-455a-882c-6d5f86f9bac1 admin admin] Calling method '>' {{(pid=109913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:33:28.888595 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: INFO nova.api.openstack.requestlog [None req-ecc84a44-3184-455a-882c-6d5f86f9bac1 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.886151 Aug 09 02:33:28.889398 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: [pid: 109913|app: 0|req: 1/3] 10.222.0.20 () {60 vars in 1292 bytes} [Tue Aug 9 02:33:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:33:31.087153 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi [None req-a03c2361-69ef-4f33-a4d2-7ce1717729f6 None None] Calling method '>' {{(pid=109914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:33:31.088018 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: INFO nova.api.openstack.requestlog [None req-a03c2361-69ef-4f33-a4d2-7ce1717729f6 None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Aug 09 02:33:31.093773 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: [pid: 109914|app: 0|req: 3/4] 10.222.0.20 () {54 vars in 931 bytes} [Tue Aug 9 02:33:31 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:33:31.569017 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi [None req-274245e4-8266-46d8-9c96-38165496c138 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "ram": 256, "disk": 1, "swap": 0, "id": "c1", "name": "cirros256", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:33:31.592505 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 02:33:31.592505 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: warnings.warn(msg) Aug 09 02:33:31.622507 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: INFO nova.api.openstack.requestlog [None req-274245e4-8266-46d8-9c96-38165496c138 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.527644 Aug 09 02:33:31.630751 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: [pid: 109913|app: 0|req: 2/5] 10.222.0.20 () {64 vars in 1283 bytes} [Tue Aug 9 02:33:31 2022] POST /compute/v2.1/flavors => generated 407 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 02:33:31.637673 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG dbcounter [-] [109914] Writing DB stats nova_api:SELECT=3 {{(pid=109914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:33:31.639202 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG dbcounter [-] [109914] Writing DB stats nova_cell1:SELECT=3 {{(pid=109914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:33:31.640016 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG dbcounter [-] [109914] Writing DB stats nova_cell0:SELECT=3 {{(pid=109914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:33:31.640967 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG dbcounter [-] [109914] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:33:31.841763 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi [None req-503b35b2-ad27-47b1-b8b9-b340c76d46dc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:33:31.846188 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 02:33:31.846188 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: warnings.warn(msg) Aug 09 02:33:31.910823 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: INFO nova.api.openstack.requestlog [None req-503b35b2-ad27-47b1-b8b9-b340c76d46dc admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.278736 Aug 09 02:33:31.911732 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: [pid: 109914|app: 0|req: 4/6] 10.222.0.20 () {64 vars in 1336 bytes} [Tue Aug 9 02:33:31 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:33:34.147728 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi [None req-274245e4-8266-46d8-9c96-38165496c138 admin admin] Calling method '>' {{(pid=109913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:33:34.148767 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: INFO nova.api.openstack.requestlog [None req-274245e4-8266-46d8-9c96-38165496c138 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Aug 09 02:33:34.149363 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: [pid: 109913|app: 0|req: 3/7] 10.222.0.20 () {54 vars in 931 bytes} [Tue Aug 9 02:33:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 02:33:34.795558 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi [None req-ed65be96-a1e1-4192-b7ed-a839ec0b30a0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "vcpus": 1, "ram": 512, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "id": "d1", "swap": 0}} {{(pid=109914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:33:34.814507 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 02:33:34.814507 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: warnings.warn(msg) Aug 09 02:33:34.837711 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: INFO nova.api.openstack.requestlog [None req-ed65be96-a1e1-4192-b7ed-a839ec0b30a0 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.682329 Aug 09 02:33:34.838655 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: [pid: 109914|app: 0|req: 5/8] 10.222.0.20 () {64 vars in 1283 bytes} [Tue Aug 9 02:33:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 02:33:34.851902 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi [None req-bd7137e4-c186-4f36-bde1-1360d33e9c96 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:33:34.855085 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 02:33:34.855085 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: warnings.warn(msg) Aug 09 02:33:34.891358 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: INFO nova.api.openstack.requestlog [None req-bd7137e4-c186-4f36-bde1-1360d33e9c96 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043751 Aug 09 02:33:34.892015 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: [pid: 109913|app: 0|req: 4/9] 10.222.0.20 () {64 vars in 1336 bytes} [Tue Aug 9 02:33:34 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:33:37.104279 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi [None req-ed65be96-a1e1-4192-b7ed-a839ec0b30a0 admin admin] Calling method '>' {{(pid=109914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:33:37.105360 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: INFO nova.api.openstack.requestlog [None req-ed65be96-a1e1-4192-b7ed-a839ec0b30a0 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Aug 09 02:33:37.114755 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: [pid: 109914|app: 0|req: 6/10] 10.222.0.20 () {54 vars in 931 bytes} [Tue Aug 9 02:33:37 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:33:37.528365 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi [None req-db8e5882-88fc-486b-8ded-5e22c60b501d admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 10, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "name": "ds1G", "ram": 1024, "swap": 0, "rxtx_factor": 1.0}} {{(pid=109913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:33:37.547880 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: INFO nova.api.openstack.requestlog [None req-db8e5882-88fc-486b-8ded-5e22c60b501d admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.436276 Aug 09 02:33:37.548407 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: [pid: 109913|app: 0|req: 5/11] 10.222.0.20 () {64 vars in 1283 bytes} [Tue Aug 9 02:33:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 02:33:37.562053 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi [None req-91a7172c-067e-49af-928e-fe56f5b3ce7f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:33:37.586525 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: INFO nova.api.openstack.requestlog [None req-91a7172c-067e-49af-928e-fe56f5b3ce7f admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028151 Aug 09 02:33:37.587098 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: [pid: 109914|app: 0|req: 7/12] 10.222.0.20 () {64 vars in 1336 bytes} [Tue Aug 9 02:33:37 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:33:39.746924 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi [None req-db8e5882-88fc-486b-8ded-5e22c60b501d admin admin] Calling method '>' {{(pid=109913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:33:39.747941 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: INFO nova.api.openstack.requestlog [None req-db8e5882-88fc-486b-8ded-5e22c60b501d admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Aug 09 02:33:39.748341 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: [pid: 109913|app: 0|req: 6/13] 10.222.0.20 () {54 vars in 931 bytes} [Tue Aug 9 02:33:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:33:40.199609 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi [None req-93872df3-bd8c-4e0f-bbaf-d28dd456de37 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "id": "d3", "disk": 10, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "name": "ds2G"}} {{(pid=109914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:33:40.226541 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: INFO nova.api.openstack.requestlog [None req-93872df3-bd8c-4e0f-bbaf-d28dd456de37 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.471511 Aug 09 02:33:40.227387 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: [pid: 109914|app: 0|req: 8/14] 10.222.0.20 () {64 vars in 1283 bytes} [Tue Aug 9 02:33:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 02:33:40.239904 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi [None req-dc556f6b-1202-4bb4-90f0-95ccb8242669 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:33:40.275172 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: INFO nova.api.openstack.requestlog [None req-dc556f6b-1202-4bb4-90f0-95ccb8242669 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038013 Aug 09 02:33:40.276786 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: [pid: 109913|app: 0|req: 7/15] 10.222.0.20 () {64 vars in 1336 bytes} [Tue Aug 9 02:33:40 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:33:42.474247 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi [None req-93872df3-bd8c-4e0f-bbaf-d28dd456de37 admin admin] Calling method '>' {{(pid=109914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:33:42.475982 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: INFO nova.api.openstack.requestlog [None req-93872df3-bd8c-4e0f-bbaf-d28dd456de37 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001823 Aug 09 02:33:42.476555 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: [pid: 109914|app: 0|req: 9/16] 10.222.0.20 () {54 vars in 931 bytes} [Tue Aug 9 02:33:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:33:42.903084 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi [None req-cc0648bd-0978-4abd-962d-71885f088565 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "vcpus": 4, "name": "ds4G", "disk": 20, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "id": "d4"}} {{(pid=109913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:33:42.923413 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: INFO nova.api.openstack.requestlog [None req-cc0648bd-0978-4abd-962d-71885f088565 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.440808 Aug 09 02:33:42.924046 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: [pid: 109913|app: 0|req: 8/17] 10.222.0.20 () {64 vars in 1283 bytes} [Tue Aug 9 02:33:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 02:33:42.936424 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi [None req-b2a728f2-d636-4fb6-b45c-b72f9a218a91 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:33:42.961601 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: INFO nova.api.openstack.requestlog [None req-b2a728f2-d636-4fb6-b45c-b72f9a218a91 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028871 Aug 09 02:33:42.962223 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: [pid: 109914|app: 0|req: 10/18] 10.222.0.20 () {64 vars in 1336 bytes} [Tue Aug 9 02:33:42 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:33:45.174757 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi [None req-cc0648bd-0978-4abd-962d-71885f088565 admin admin] Calling method '>' {{(pid=109913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:33:45.175914 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: INFO nova.api.openstack.requestlog [None req-cc0648bd-0978-4abd-962d-71885f088565 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001676 Aug 09 02:33:45.176395 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: [pid: 109913|app: 0|req: 9/19] 10.222.0.20 () {54 vars in 931 bytes} [Tue Aug 9 02:33:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:33:45.628225 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi [None req-8f367c30-6103-471f-b14e-b82da051f6b2 admin admin] Calling method '>' {{(pid=109914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:33:45.653342 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: INFO nova.api.openstack.requestlog [None req-8f367c30-6103-471f-b14e-b82da051f6b2 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.470166 Aug 09 02:33:45.653937 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: [pid: 109914|app: 0|req: 11/20] 10.222.0.20 () {60 vars in 1292 bytes} [Tue Aug 9 02:33:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:33:47.861307 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi [None req-cc0648bd-0978-4abd-962d-71885f088565 admin admin] Calling method '>' {{(pid=109913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:33:47.862530 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: INFO nova.api.openstack.requestlog [None req-cc0648bd-0978-4abd-962d-71885f088565 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001713 Aug 09 02:33:47.862960 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: [pid: 109913|app: 0|req: 10/21] 10.222.0.20 () {54 vars in 931 bytes} [Tue Aug 9 02:33:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:33:48.360863 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi [None req-925de3a5-72ed-446a-87bf-33b3a771aaa2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "swap": 0, "name": "m1.tiny", "id": "1", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=109914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:33:48.389266 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: INFO nova.api.openstack.requestlog [None req-925de3a5-72ed-446a-87bf-33b3a771aaa2 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.519218 Aug 09 02:33:48.389849 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: [pid: 109914|app: 0|req: 12/22] 10.222.0.20 () {64 vars in 1283 bytes} [Tue Aug 9 02:33:47 2022] POST /compute/v2.1/flavors => generated 402 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 02:33:48.402550 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi [None req-1193489c-adc9-4a58-9611-600003da5924 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:33:48.428887 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: INFO nova.api.openstack.requestlog [None req-1193489c-adc9-4a58-9611-600003da5924 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030210 Aug 09 02:33:48.429459 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: [pid: 109913|app: 0|req: 11/23] 10.222.0.20 () {64 vars in 1333 bytes} [Tue Aug 9 02:33:48 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:33:50.628916 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi [None req-925de3a5-72ed-446a-87bf-33b3a771aaa2 admin admin] Calling method '>' {{(pid=109914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:33:50.629979 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: INFO nova.api.openstack.requestlog [None req-925de3a5-72ed-446a-87bf-33b3a771aaa2 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001555 Aug 09 02:33:50.630378 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: [pid: 109914|app: 0|req: 13/24] 10.222.0.20 () {54 vars in 931 bytes} [Tue Aug 9 02:33:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:33:51.159443 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi [None req-583b728d-c832-4db6-9d7e-d4ddb70ebbe8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "id": "2", "name": "m1.small", "swap": 0, "vcpus": 1, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:33:51.180066 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: INFO nova.api.openstack.requestlog [None req-583b728d-c832-4db6-9d7e-d4ddb70ebbe8 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.543493 Aug 09 02:33:51.180613 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: [pid: 109913|app: 0|req: 12/25] 10.222.0.20 () {64 vars in 1283 bytes} [Tue Aug 9 02:33:50 2022] POST /compute/v2.1/flavors => generated 405 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 02:33:51.192740 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi [None req-27bf959a-3c92-43a8-8979-982ec504d4a7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:33:51.217075 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: INFO nova.api.openstack.requestlog [None req-27bf959a-3c92-43a8-8979-982ec504d4a7 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028067 Aug 09 02:33:51.217641 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: [pid: 109914|app: 0|req: 14/26] 10.222.0.20 () {64 vars in 1333 bytes} [Tue Aug 9 02:33:51 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:33:53.406403 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi [None req-583b728d-c832-4db6-9d7e-d4ddb70ebbe8 admin admin] Calling method '>' {{(pid=109913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:33:53.407347 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: INFO nova.api.openstack.requestlog [None req-583b728d-c832-4db6-9d7e-d4ddb70ebbe8 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001795 Aug 09 02:33:53.407748 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: [pid: 109913|app: 0|req: 13/27] 10.222.0.20 () {54 vars in 931 bytes} [Tue Aug 9 02:33:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:33:53.781293 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi [None req-2d4b070b-a8eb-4671-ac87-f416e56147e8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "swap": 0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 2, "id": "3", "disk": 40, "os-flavor-access:is_public": true}} {{(pid=109914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:33:53.800718 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: INFO nova.api.openstack.requestlog [None req-2d4b070b-a8eb-4671-ac87-f416e56147e8 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.386606 Aug 09 02:33:53.801284 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: [pid: 109914|app: 0|req: 15/28] 10.222.0.20 () {64 vars in 1283 bytes} [Tue Aug 9 02:33:53 2022] POST /compute/v2.1/flavors => generated 406 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 02:33:53.814515 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi [None req-9dd2aab3-d4bd-4c9e-a5f3-49c1ea9d98e3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:33:53.841791 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: INFO nova.api.openstack.requestlog [None req-9dd2aab3-d4bd-4c9e-a5f3-49c1ea9d98e3 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031646 Aug 09 02:33:53.842373 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: [pid: 109913|app: 0|req: 14/29] 10.222.0.20 () {64 vars in 1333 bytes} [Tue Aug 9 02:33:53 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:33:56.044737 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi [None req-2d4b070b-a8eb-4671-ac87-f416e56147e8 admin admin] Calling method '>' {{(pid=109914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:33:56.046410 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: INFO nova.api.openstack.requestlog [None req-2d4b070b-a8eb-4671-ac87-f416e56147e8 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002104 Aug 09 02:33:56.047262 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: [pid: 109914|app: 0|req: 16/30] 10.222.0.20 () {54 vars in 931 bytes} [Tue Aug 9 02:33:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:33:56.500619 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi [None req-11533f12-08b7-4786-b832-a07572ff631e admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "ram": 8192, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "name": "m1.large", "rxtx_factor": 1.0, "vcpus": 4}} {{(pid=109913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:33:56.526048 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: INFO nova.api.openstack.requestlog [None req-11533f12-08b7-4786-b832-a07572ff631e admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.472934 Aug 09 02:33:56.526635 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: [pid: 109913|app: 0|req: 15/31] 10.222.0.20 () {64 vars in 1283 bytes} [Tue Aug 9 02:33:56 2022] POST /compute/v2.1/flavors => generated 405 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 02:33:56.538960 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi [None req-5a0a4600-948f-46ac-9abd-7477e29b070e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:33:56.570396 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: INFO nova.api.openstack.requestlog [None req-5a0a4600-948f-46ac-9abd-7477e29b070e admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035226 Aug 09 02:33:56.571586 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: [pid: 109914|app: 0|req: 17/32] 10.222.0.20 () {64 vars in 1333 bytes} [Tue Aug 9 02:33:56 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:33:58.804602 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi [None req-11533f12-08b7-4786-b832-a07572ff631e admin admin] Calling method '>' {{(pid=109913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:33:58.806328 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: INFO nova.api.openstack.requestlog [None req-11533f12-08b7-4786-b832-a07572ff631e admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002128 Aug 09 02:33:58.811669 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: [pid: 109913|app: 0|req: 16/33] 10.222.0.20 () {54 vars in 931 bytes} [Tue Aug 9 02:33:58 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:33:59.246316 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi [None req-771f3a2a-a61e-4545-8763-47186ed369e3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 160, "name": "m1.xlarge", "vcpus": 8, "id": "5", "ram": 16384, "swap": 0}} {{(pid=109914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:33:59.268365 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: INFO nova.api.openstack.requestlog [None req-771f3a2a-a61e-4545-8763-47186ed369e3 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.455249 Aug 09 02:33:59.269167 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: [pid: 109914|app: 0|req: 18/34] 10.222.0.20 () {64 vars in 1283 bytes} [Tue Aug 9 02:33:58 2022] POST /compute/v2.1/flavors => generated 408 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 02:33:59.281479 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi [None req-1700d49c-1fa6-4be0-a752-ed7297d653df admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:33:59.286526 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG dbcounter [-] [109913] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=109913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:33:59.308529 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: INFO nova.api.openstack.requestlog [None req-1700d49c-1fa6-4be0-a752-ed7297d653df admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030784 Aug 09 02:33:59.309443 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: [pid: 109913|app: 0|req: 17/35] 10.222.0.20 () {64 vars in 1333 bytes} [Tue Aug 9 02:33:59 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:34:18.721228 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi [None req-771f3a2a-a61e-4545-8763-47186ed369e3 admin admin] Calling method '>' {{(pid=109914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:34:18.722266 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: INFO nova.api.openstack.requestlog [None req-771f3a2a-a61e-4545-8763-47186ed369e3 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Aug 09 02:34:18.722667 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: [pid: 109914|app: 0|req: 19/36] 10.222.0.20 () {54 vars in 931 bytes} [Tue Aug 9 02:34:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:34:19.134505 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi [None req-18d3e578-8f1c-4609-ab79-200fb4fde5de admin admin] Calling method '>' {{(pid=109913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:34:19.153251 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: INFO nova.api.openstack.requestlog [None req-18d3e578-8f1c-4609-ab79-200fb4fde5de admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.424326 Aug 09 02:34:19.153787 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: [pid: 109913|app: 0|req: 18/37] 10.222.0.20 () {60 vars in 1292 bytes} [Tue Aug 9 02:34:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:34:20.236310 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi [None req-771f3a2a-a61e-4545-8763-47186ed369e3 admin admin] Calling method '>' {{(pid=109914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:34:20.237313 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: INFO nova.api.openstack.requestlog [None req-771f3a2a-a61e-4545-8763-47186ed369e3 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Aug 09 02:34:20.237704 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: [pid: 109914|app: 0|req: 20/38] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Aug 9 02:34:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:34:20.794316 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi [None req-0d4d0a40-503d-497b-b9c2-9da117c511e8 admin admin] Calling method '>' {{(pid=109913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:34:20.799960 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: INFO nova.api.openstack.wsgi [None req-0d4d0a40-503d-497b-b9c2-9da117c511e8 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 09 02:34:20.803217 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi [None req-0d4d0a40-503d-497b-b9c2-9da117c511e8 admin admin] Request method failure captured: Aug 09 02:34:20.803217 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 09 02:34:20.803217 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: Accept: application/json Aug 09 02:34:20.803217 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: Accept-Encoding: gzip, deflate Aug 09 02:34:20.803217 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: Connection: keep-alive Aug 09 02:34:20.803217 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: Content-Length: 0 Aug 09 02:34:20.803217 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: Host: 10.222.0.20 Aug 09 02:34:20.803217 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: Openstack-Api-Version: compute 2.90 Aug 09 02:34:20.803217 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: Openstack-System-Scope: None Aug 09 02:34:20.803217 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: User-Agent: python-novaclient Aug 09 02:34:20.803217 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: X-Auth-Token: gAAAAABi8ces6WIV5FQevP4iU6m1chLcMeFgQpkWgI4zw0tL4nl8HvFWgWhH6VYl1z_JHOI8GVKH12TaSTglH5nQhuIjZg95Wk-HfCBaeIKClDXo0ZjMkUNtMIun29K2W-gMuOAi_nCRtXK0Yn4RhDi44aFvr-_vxJdR9x1tYKjxltmQSyEY_7A Aug 09 02:34:20.803217 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: X-Domain-Id: None Aug 09 02:34:20.803217 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: X-Domain-Name: None Aug 09 02:34:20.803217 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: X-Identity-Status: Confirmed Aug 09 02:34:20.803217 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: X-Is-Admin-Project: True Aug 09 02:34:20.803217 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 02:34:20.803217 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: X-Project-Domain-Id: default Aug 09 02:34:20.803217 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: X-Project-Domain-Name: Default Aug 09 02:34:20.803217 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: X-Project-Id: aaeb91952f2c4c9f8cf8e3a10b5518c9 Aug 09 02:34:20.803217 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: X-Project-Name: admin Aug 09 02:34:20.803217 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: X-Role: reader,member,admin Aug 09 02:34:20.803217 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: X-Roles: reader,member,admin Aug 09 02:34:20.804921 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aaeb91952f2c4c9f8cf8e3a10b5518c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aaeb91952f2c4c9f8cf8e3a10b5518c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aaeb91952f2c4c9f8cf8e3a10b5518c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aaeb91952f2c4c9f8cf8e3a10b5518c9"}]}] Aug 09 02:34:20.804921 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: X-Tenant: admin Aug 09 02:34:20.804921 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: X-Tenant-Id: aaeb91952f2c4c9f8cf8e3a10b5518c9 Aug 09 02:34:20.804921 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: X-Tenant-Name: admin Aug 09 02:34:20.804921 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: X-User: admin Aug 09 02:34:20.804921 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: X-User-Domain-Id: default Aug 09 02:34:20.804921 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: X-User-Domain-Name: Default Aug 09 02:34:20.804921 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: X-User-Id: b1cb94a6532045fc84cecdb848b352fb Aug 09 02:34:20.804921 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: X-User-Name: admin Aug 09 02:34:20.804921 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: method: > Aug 09 02:34:20.804921 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: exception: Flavor 42 could not be found. Aug 09 02:34:20.804921 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: action_args: {'id': '42'} Aug 09 02:34:20.804921 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: {{(pid=109913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 02:34:20.804921 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:34:20.805991 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 02:34:20.805991 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 02:34:20.805991 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 02:34:20.805991 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 02:34:20.805991 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 02:34:20.805991 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 02:34:20.805991 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 02:34:20.805991 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 02:34:20.805991 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 02:34:20.805991 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 02:34:20.805991 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 02:34:20.805991 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 02:34:20.805991 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 09 02:34:20.805991 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi Aug 09 02:34:20.805991 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:34:20.805991 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi Aug 09 02:34:20.805991 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:34:20.805991 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:34:20.805991 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:34:20.807514 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 02:34:20.807514 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 02:34:20.807514 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 02:34:20.807514 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 02:34:20.807514 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 02:34:20.807514 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 02:34:20.807514 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 09 02:34:20.807514 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi Aug 09 02:34:20.807514 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:34:20.807514 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi Aug 09 02:34:20.807514 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:34:20.807514 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:34:20.807514 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:34:20.807514 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 02:34:20.807514 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 02:34:20.807514 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 09 02:34:20.807514 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi Aug 09 02:34:20.807514 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi [None req-0d4d0a40-503d-497b-b9c2-9da117c511e8 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109913) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 02:34:20.808812 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: INFO nova.api.openstack.requestlog [None req-0d4d0a40-503d-497b-b9c2-9da117c511e8 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.429572 Aug 09 02:34:20.808812 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: [pid: 109913|app: 0|req: 19/39] 10.222.0.20 () {60 vars in 1190 bytes} [Tue Aug 9 02:34:20 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 431 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 09 02:34:20.814662 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi [None req-03c89963-7df5-4f3d-bd76-e480c056340e admin admin] Calling method '>' {{(pid=109914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:34:20.818852 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG dbcounter [-] [109914] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=109914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:34:20.837928 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: INFO nova.api.openstack.requestlog [None req-03c89963-7df5-4f3d-bd76-e480c056340e admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026857 Aug 09 02:34:20.838464 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: [pid: 109914|app: 0|req: 21/40] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Aug 9 02:34:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:34:20.848375 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi [None req-c17d6e97-6b34-4ae3-ac93-5a45cce51e72 admin admin] Calling method '>' {{(pid=109913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:34:20.872718 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: INFO nova.api.openstack.requestlog [None req-c17d6e97-6b34-4ae3-ac93-5a45cce51e72 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027860 Aug 09 02:34:20.873245 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: [pid: 109913|app: 0|req: 20/41] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Aug 9 02:34:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:34:20.883759 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi [None req-449223cb-99f5-4f7a-9476-1f684c2199a1 admin admin] Calling method '>' {{(pid=109914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:34:20.889845 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: INFO nova.api.openstack.wsgi [None req-449223cb-99f5-4f7a-9476-1f684c2199a1 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 09 02:34:20.893114 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi [None req-449223cb-99f5-4f7a-9476-1f684c2199a1 admin admin] Request method failure captured: Aug 09 02:34:20.893114 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 09 02:34:20.893114 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: Accept: application/json Aug 09 02:34:20.893114 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: Accept-Encoding: gzip, deflate Aug 09 02:34:20.893114 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: Connection: keep-alive Aug 09 02:34:20.893114 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: Content-Length: 0 Aug 09 02:34:20.893114 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: Host: 10.222.0.20 Aug 09 02:34:20.893114 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: Openstack-Api-Version: compute 2.90 Aug 09 02:34:20.893114 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: Openstack-System-Scope: None Aug 09 02:34:20.893114 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: User-Agent: python-novaclient Aug 09 02:34:20.893114 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: X-Auth-Token: gAAAAABi8ces6WIV5FQevP4iU6m1chLcMeFgQpkWgI4zw0tL4nl8HvFWgWhH6VYl1z_JHOI8GVKH12TaSTglH5nQhuIjZg95Wk-HfCBaeIKClDXo0ZjMkUNtMIun29K2W-gMuOAi_nCRtXK0Yn4RhDi44aFvr-_vxJdR9x1tYKjxltmQSyEY_7A Aug 09 02:34:20.893114 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: X-Domain-Id: None Aug 09 02:34:20.893114 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: X-Domain-Name: None Aug 09 02:34:20.893114 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: X-Identity-Status: Confirmed Aug 09 02:34:20.893114 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: X-Is-Admin-Project: True Aug 09 02:34:20.893114 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 02:34:20.893114 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: X-Project-Domain-Id: default Aug 09 02:34:20.893114 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: X-Project-Domain-Name: Default Aug 09 02:34:20.893114 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: X-Project-Id: aaeb91952f2c4c9f8cf8e3a10b5518c9 Aug 09 02:34:20.893114 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: X-Project-Name: admin Aug 09 02:34:20.893114 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: X-Role: reader,member,admin Aug 09 02:34:20.893114 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: X-Roles: reader,member,admin Aug 09 02:34:20.894673 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aaeb91952f2c4c9f8cf8e3a10b5518c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aaeb91952f2c4c9f8cf8e3a10b5518c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aaeb91952f2c4c9f8cf8e3a10b5518c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aaeb91952f2c4c9f8cf8e3a10b5518c9"}]}] Aug 09 02:34:20.894673 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: X-Tenant: admin Aug 09 02:34:20.894673 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: X-Tenant-Id: aaeb91952f2c4c9f8cf8e3a10b5518c9 Aug 09 02:34:20.894673 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: X-Tenant-Name: admin Aug 09 02:34:20.894673 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: X-User: admin Aug 09 02:34:20.894673 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: X-User-Domain-Id: default Aug 09 02:34:20.894673 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: X-User-Domain-Name: Default Aug 09 02:34:20.894673 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: X-User-Id: b1cb94a6532045fc84cecdb848b352fb Aug 09 02:34:20.894673 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: X-User-Name: admin Aug 09 02:34:20.894673 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: method: > Aug 09 02:34:20.894673 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: exception: Flavor 42 could not be found. Aug 09 02:34:20.894673 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: action_args: {'id': '42'} Aug 09 02:34:20.894673 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: {{(pid=109914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 02:34:20.894673 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:34:20.895562 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 02:34:20.895562 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 02:34:20.895562 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 02:34:20.895562 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 02:34:20.895562 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 02:34:20.895562 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 02:34:20.895562 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 02:34:20.895562 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 02:34:20.895562 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 02:34:20.895562 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 02:34:20.895562 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 02:34:20.895562 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 02:34:20.895562 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 09 02:34:20.895562 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi Aug 09 02:34:20.895562 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:34:20.895562 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi Aug 09 02:34:20.895562 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:34:20.895562 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:34:20.895562 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:34:20.896649 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 02:34:20.896649 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 02:34:20.896649 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 02:34:20.896649 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 02:34:20.896649 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 02:34:20.896649 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 02:34:20.896649 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 09 02:34:20.896649 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi Aug 09 02:34:20.896649 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:34:20.896649 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi Aug 09 02:34:20.896649 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:34:20.896649 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:34:20.896649 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:34:20.896649 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 02:34:20.896649 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 02:34:20.896649 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 09 02:34:20.896649 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi Aug 09 02:34:20.896649 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi [None req-449223cb-99f5-4f7a-9476-1f684c2199a1 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 02:34:20.897674 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: INFO nova.api.openstack.requestlog [None req-449223cb-99f5-4f7a-9476-1f684c2199a1 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015108 Aug 09 02:34:20.897674 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: [pid: 109914|app: 0|req: 22/42] 10.222.0.20 () {60 vars in 1190 bytes} [Tue Aug 9 02:34:20 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 09 02:34:21.885653 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi [None req-c17d6e97-6b34-4ae3-ac93-5a45cce51e72 admin admin] Calling method '>' {{(pid=109913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:34:21.886700 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: INFO nova.api.openstack.requestlog [None req-c17d6e97-6b34-4ae3-ac93-5a45cce51e72 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Aug 09 02:34:21.887093 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: [pid: 109913|app: 0|req: 21/43] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Aug 9 02:34:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:34:22.443659 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi [None req-67b75763-1416-4ef4-aa55-7d7c210d4507 admin admin] Calling method '>' {{(pid=109914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:34:22.449227 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: INFO nova.api.openstack.wsgi [None req-67b75763-1416-4ef4-aa55-7d7c210d4507 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 09 02:34:22.450776 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi [None req-67b75763-1416-4ef4-aa55-7d7c210d4507 admin admin] Request method failure captured: Aug 09 02:34:22.450776 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 09 02:34:22.450776 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: Accept: application/json Aug 09 02:34:22.450776 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: Accept-Encoding: gzip, deflate Aug 09 02:34:22.450776 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: Connection: keep-alive Aug 09 02:34:22.450776 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: Content-Length: 0 Aug 09 02:34:22.450776 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: Host: 10.222.0.20 Aug 09 02:34:22.450776 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: Openstack-Api-Version: compute 2.90 Aug 09 02:34:22.450776 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: Openstack-System-Scope: None Aug 09 02:34:22.450776 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: User-Agent: python-novaclient Aug 09 02:34:22.450776 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: X-Auth-Token: gAAAAABi8cetKdxQtHwzqFnIum--wBDYN6wrZlp3fGbU-Y5WVsgVfI7Cr67dwY5NlWa5onCKsLhUdipxCGUvDN9c-WgbJwYPkFiChI3rCAEheRrkbCHTRmd4X_ii4Ih6faL-h4hPe2bVXFJEMbsNuDbvmiUITBAjfVQssrtnqqML9suHzFg-IgI Aug 09 02:34:22.450776 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: X-Domain-Id: None Aug 09 02:34:22.450776 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: X-Domain-Name: None Aug 09 02:34:22.450776 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: X-Identity-Status: Confirmed Aug 09 02:34:22.450776 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: X-Is-Admin-Project: True Aug 09 02:34:22.450776 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 02:34:22.450776 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: X-Project-Domain-Id: default Aug 09 02:34:22.450776 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: X-Project-Domain-Name: Default Aug 09 02:34:22.450776 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: X-Project-Id: aaeb91952f2c4c9f8cf8e3a10b5518c9 Aug 09 02:34:22.450776 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: X-Project-Name: admin Aug 09 02:34:22.450776 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: X-Role: reader,member,admin Aug 09 02:34:22.450776 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: X-Roles: reader,member,admin Aug 09 02:34:22.452237 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aaeb91952f2c4c9f8cf8e3a10b5518c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aaeb91952f2c4c9f8cf8e3a10b5518c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aaeb91952f2c4c9f8cf8e3a10b5518c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aaeb91952f2c4c9f8cf8e3a10b5518c9"}]}] Aug 09 02:34:22.452237 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: X-Tenant: admin Aug 09 02:34:22.452237 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: X-Tenant-Id: aaeb91952f2c4c9f8cf8e3a10b5518c9 Aug 09 02:34:22.452237 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: X-Tenant-Name: admin Aug 09 02:34:22.452237 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: X-User: admin Aug 09 02:34:22.452237 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: X-User-Domain-Id: default Aug 09 02:34:22.452237 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: X-User-Domain-Name: Default Aug 09 02:34:22.452237 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: X-User-Id: b1cb94a6532045fc84cecdb848b352fb Aug 09 02:34:22.452237 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: X-User-Name: admin Aug 09 02:34:22.452237 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: method: > Aug 09 02:34:22.452237 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: exception: Flavor 84 could not be found. Aug 09 02:34:22.452237 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: action_args: {'id': '84'} Aug 09 02:34:22.452237 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: {{(pid=109914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 02:34:22.452237 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:34:22.453123 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 02:34:22.453123 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 02:34:22.453123 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 02:34:22.453123 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 02:34:22.453123 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 02:34:22.453123 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 02:34:22.453123 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 02:34:22.453123 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 02:34:22.453123 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 02:34:22.453123 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 02:34:22.453123 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 02:34:22.453123 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 02:34:22.453123 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 09 02:34:22.453123 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi Aug 09 02:34:22.453123 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:34:22.453123 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi Aug 09 02:34:22.453123 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:34:22.453123 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:34:22.453123 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:34:22.454262 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 02:34:22.454262 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 02:34:22.454262 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 02:34:22.454262 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 02:34:22.454262 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 02:34:22.454262 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 02:34:22.454262 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 09 02:34:22.454262 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi Aug 09 02:34:22.454262 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:34:22.454262 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi Aug 09 02:34:22.454262 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:34:22.454262 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:34:22.454262 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:34:22.454262 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 02:34:22.454262 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 02:34:22.454262 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 09 02:34:22.454262 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi Aug 09 02:34:22.454262 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi [None req-67b75763-1416-4ef4-aa55-7d7c210d4507 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 02:34:22.455301 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: INFO nova.api.openstack.requestlog [None req-67b75763-1416-4ef4-aa55-7d7c210d4507 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.428983 Aug 09 02:34:22.455301 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: [pid: 109914|app: 0|req: 23/44] 10.222.0.20 () {60 vars in 1190 bytes} [Tue Aug 9 02:34:22 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 430 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 09 02:34:22.464187 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi [None req-38c84875-0f9b-4d43-bee5-b3073162491f admin admin] Calling method '>' {{(pid=109913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:34:22.480136 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: INFO nova.api.openstack.requestlog [None req-38c84875-0f9b-4d43-bee5-b3073162491f admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020543 Aug 09 02:34:22.480657 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: [pid: 109913|app: 0|req: 22/45] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Aug 9 02:34:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:34:22.490177 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi [None req-8e4820ba-c197-483c-b5a1-7c862d0d053a admin admin] Calling method '>' {{(pid=109914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:34:22.505584 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: INFO nova.api.openstack.requestlog [None req-8e4820ba-c197-483c-b5a1-7c862d0d053a admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018978 Aug 09 02:34:22.506315 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: [pid: 109914|app: 0|req: 24/46] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Aug 9 02:34:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 02:34:22.515356 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi [None req-aa4c1986-a7e1-40b1-937c-132a359d7b29 admin admin] Calling method '>' {{(pid=109913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:34:22.520773 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: INFO nova.api.openstack.wsgi [None req-aa4c1986-a7e1-40b1-937c-132a359d7b29 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 09 02:34:22.522311 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi [None req-aa4c1986-a7e1-40b1-937c-132a359d7b29 admin admin] Request method failure captured: Aug 09 02:34:22.522311 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 09 02:34:22.522311 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: Accept: application/json Aug 09 02:34:22.522311 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: Accept-Encoding: gzip, deflate Aug 09 02:34:22.522311 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: Connection: keep-alive Aug 09 02:34:22.522311 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: Content-Length: 0 Aug 09 02:34:22.522311 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: Host: 10.222.0.20 Aug 09 02:34:22.522311 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: Openstack-Api-Version: compute 2.90 Aug 09 02:34:22.522311 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: Openstack-System-Scope: None Aug 09 02:34:22.522311 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: User-Agent: python-novaclient Aug 09 02:34:22.522311 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: X-Auth-Token: gAAAAABi8cetKdxQtHwzqFnIum--wBDYN6wrZlp3fGbU-Y5WVsgVfI7Cr67dwY5NlWa5onCKsLhUdipxCGUvDN9c-WgbJwYPkFiChI3rCAEheRrkbCHTRmd4X_ii4Ih6faL-h4hPe2bVXFJEMbsNuDbvmiUITBAjfVQssrtnqqML9suHzFg-IgI Aug 09 02:34:22.522311 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: X-Domain-Id: None Aug 09 02:34:22.522311 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: X-Domain-Name: None Aug 09 02:34:22.522311 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: X-Identity-Status: Confirmed Aug 09 02:34:22.522311 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: X-Is-Admin-Project: True Aug 09 02:34:22.522311 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 02:34:22.522311 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: X-Project-Domain-Id: default Aug 09 02:34:22.522311 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: X-Project-Domain-Name: Default Aug 09 02:34:22.522311 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: X-Project-Id: aaeb91952f2c4c9f8cf8e3a10b5518c9 Aug 09 02:34:22.522311 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: X-Project-Name: admin Aug 09 02:34:22.522311 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: X-Role: reader,member,admin Aug 09 02:34:22.522311 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: X-Roles: reader,member,admin Aug 09 02:34:22.523853 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aaeb91952f2c4c9f8cf8e3a10b5518c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aaeb91952f2c4c9f8cf8e3a10b5518c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aaeb91952f2c4c9f8cf8e3a10b5518c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aaeb91952f2c4c9f8cf8e3a10b5518c9"}]}] Aug 09 02:34:22.523853 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: X-Tenant: admin Aug 09 02:34:22.523853 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: X-Tenant-Id: aaeb91952f2c4c9f8cf8e3a10b5518c9 Aug 09 02:34:22.523853 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: X-Tenant-Name: admin Aug 09 02:34:22.523853 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: X-User: admin Aug 09 02:34:22.523853 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: X-User-Domain-Id: default Aug 09 02:34:22.523853 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: X-User-Domain-Name: Default Aug 09 02:34:22.523853 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: X-User-Id: b1cb94a6532045fc84cecdb848b352fb Aug 09 02:34:22.523853 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: X-User-Name: admin Aug 09 02:34:22.523853 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: method: > Aug 09 02:34:22.523853 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: exception: Flavor 84 could not be found. Aug 09 02:34:22.523853 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: action_args: {'id': '84'} Aug 09 02:34:22.523853 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: {{(pid=109913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 02:34:22.523853 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:34:22.524850 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 02:34:22.524850 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 02:34:22.524850 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 02:34:22.524850 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 02:34:22.524850 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 02:34:22.524850 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 02:34:22.524850 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 02:34:22.524850 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 02:34:22.524850 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 02:34:22.524850 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 02:34:22.524850 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 02:34:22.524850 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 02:34:22.524850 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 09 02:34:22.524850 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi Aug 09 02:34:22.524850 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:34:22.524850 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi Aug 09 02:34:22.524850 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:34:22.524850 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:34:22.524850 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:34:22.526007 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 02:34:22.526007 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 02:34:22.526007 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 02:34:22.526007 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 02:34:22.526007 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 02:34:22.526007 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 02:34:22.526007 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 09 02:34:22.526007 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi Aug 09 02:34:22.526007 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:34:22.526007 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi Aug 09 02:34:22.526007 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:34:22.526007 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:34:22.526007 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:34:22.526007 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 02:34:22.526007 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 02:34:22.526007 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 09 02:34:22.526007 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi Aug 09 02:34:22.526007 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi [None req-aa4c1986-a7e1-40b1-937c-132a359d7b29 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109913) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 02:34:22.527601 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: INFO nova.api.openstack.requestlog [None req-aa4c1986-a7e1-40b1-937c-132a359d7b29 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011842 Aug 09 02:34:22.527601 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: [pid: 109913|app: 0|req: 23/47] 10.222.0.20 () {60 vars in 1190 bytes} [Tue Aug 9 02:34:22 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 09 02:34:23.493538 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi [None req-8e4820ba-c197-483c-b5a1-7c862d0d053a admin admin] Calling method '>' {{(pid=109914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:34:23.494682 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: INFO nova.api.openstack.requestlog [None req-8e4820ba-c197-483c-b5a1-7c862d0d053a admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001655 Aug 09 02:34:23.495196 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: [pid: 109914|app: 0|req: 25/48] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Aug 9 02:34:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:34:24.055373 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi [None req-3e7ead5e-241f-443b-a9b0-26cb103f6f7e admin admin] Calling method '>' {{(pid=109913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:34:24.061422 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: INFO nova.api.openstack.wsgi [None req-3e7ead5e-241f-443b-a9b0-26cb103f6f7e admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 09 02:34:24.062925 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi [None req-3e7ead5e-241f-443b-a9b0-26cb103f6f7e admin admin] Request method failure captured: Aug 09 02:34:24.062925 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 09 02:34:24.062925 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: Accept: application/json Aug 09 02:34:24.062925 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: Accept-Encoding: gzip, deflate Aug 09 02:34:24.062925 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: Connection: keep-alive Aug 09 02:34:24.062925 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: Content-Length: 0 Aug 09 02:34:24.062925 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: Host: 10.222.0.20 Aug 09 02:34:24.062925 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: Openstack-Api-Version: compute 2.90 Aug 09 02:34:24.062925 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: Openstack-System-Scope: None Aug 09 02:34:24.062925 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: User-Agent: python-novaclient Aug 09 02:34:24.062925 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: X-Auth-Token: gAAAAABi8cevoXfe3nTAvgZFzRIZa7XlwaZAlrE_SJTQvKtrInuwxQNPjAuvjy5Mx-ayhMl1r7q43MjF0B0LbXDNW_BAsQtNoVyXM3kpG6APT7RVIULKza54Z0MevPZAYVlURZvLqGymYLSAjbVEDeBPnvqYJM3lKC_B2TvMMxNIlbhE9516IXo Aug 09 02:34:24.062925 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: X-Domain-Id: None Aug 09 02:34:24.062925 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: X-Domain-Name: None Aug 09 02:34:24.062925 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: X-Identity-Status: Confirmed Aug 09 02:34:24.062925 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: X-Is-Admin-Project: True Aug 09 02:34:24.062925 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 02:34:24.062925 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: X-Project-Domain-Id: default Aug 09 02:34:24.062925 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: X-Project-Domain-Name: Default Aug 09 02:34:24.062925 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: X-Project-Id: aaeb91952f2c4c9f8cf8e3a10b5518c9 Aug 09 02:34:24.062925 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: X-Project-Name: admin Aug 09 02:34:24.062925 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: X-Role: reader,member,admin Aug 09 02:34:24.062925 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: X-Roles: reader,member,admin Aug 09 02:34:24.064468 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aaeb91952f2c4c9f8cf8e3a10b5518c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aaeb91952f2c4c9f8cf8e3a10b5518c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aaeb91952f2c4c9f8cf8e3a10b5518c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aaeb91952f2c4c9f8cf8e3a10b5518c9"}]}] Aug 09 02:34:24.064468 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: X-Tenant: admin Aug 09 02:34:24.064468 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: X-Tenant-Id: aaeb91952f2c4c9f8cf8e3a10b5518c9 Aug 09 02:34:24.064468 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: X-Tenant-Name: admin Aug 09 02:34:24.064468 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: X-User: admin Aug 09 02:34:24.064468 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: X-User-Domain-Id: default Aug 09 02:34:24.064468 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: X-User-Domain-Name: Default Aug 09 02:34:24.064468 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: X-User-Id: b1cb94a6532045fc84cecdb848b352fb Aug 09 02:34:24.064468 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: X-User-Name: admin Aug 09 02:34:24.064468 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: method: > Aug 09 02:34:24.064468 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: exception: Flavor 451 could not be found. Aug 09 02:34:24.064468 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: action_args: {'id': '451'} Aug 09 02:34:24.064468 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: {{(pid=109913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 02:34:24.064468 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:34:24.065630 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 02:34:24.065630 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 02:34:24.065630 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 02:34:24.065630 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 02:34:24.065630 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 02:34:24.065630 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 02:34:24.065630 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 02:34:24.065630 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 02:34:24.065630 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 02:34:24.065630 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 02:34:24.065630 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 02:34:24.065630 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 02:34:24.065630 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 09 02:34:24.065630 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi Aug 09 02:34:24.065630 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:34:24.065630 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi Aug 09 02:34:24.065630 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:34:24.065630 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:34:24.065630 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:34:24.067134 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 02:34:24.067134 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 02:34:24.067134 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 02:34:24.067134 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 02:34:24.067134 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 02:34:24.067134 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 02:34:24.067134 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 09 02:34:24.067134 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi Aug 09 02:34:24.067134 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:34:24.067134 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi Aug 09 02:34:24.067134 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:34:24.067134 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:34:24.067134 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:34:24.067134 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 02:34:24.067134 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 02:34:24.067134 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 09 02:34:24.067134 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: ERROR nova.api.openstack.wsgi Aug 09 02:34:24.067134 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi [None req-3e7ead5e-241f-443b-a9b0-26cb103f6f7e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109913) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 02:34:24.068888 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: INFO nova.api.openstack.requestlog [None req-3e7ead5e-241f-443b-a9b0-26cb103f6f7e admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.434474 Aug 09 02:34:24.068888 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: [pid: 109913|app: 0|req: 24/49] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Aug 9 02:34:23 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 436 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 09 02:34:24.076060 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi [None req-3fad586a-fca8-4999-b009-d32721ae2f75 admin admin] Calling method '>' {{(pid=109914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:34:24.091575 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: INFO nova.api.openstack.requestlog [None req-3fad586a-fca8-4999-b009-d32721ae2f75 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019154 Aug 09 02:34:24.092092 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: [pid: 109914|app: 0|req: 26/50] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Aug 9 02:34:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:34:24.101856 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi [None req-e4ccca66-cf83-4434-9c93-ea28dd158743 admin admin] Calling method '>' {{(pid=109913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:34:24.116549 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: INFO nova.api.openstack.requestlog [None req-e4ccca66-cf83-4434-9c93-ea28dd158743 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018628 Aug 09 02:34:24.117031 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: [pid: 109913|app: 0|req: 25/51] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Aug 9 02:34:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 02:34:24.129273 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi [None req-e87d749d-be28-4c5d-9177-324d40914e5c admin admin] Calling method '>' {{(pid=109914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:34:24.136275 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: INFO nova.api.openstack.wsgi [None req-e87d749d-be28-4c5d-9177-324d40914e5c admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 09 02:34:24.137764 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi [None req-e87d749d-be28-4c5d-9177-324d40914e5c admin admin] Request method failure captured: Aug 09 02:34:24.137764 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 09 02:34:24.137764 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: Accept: application/json Aug 09 02:34:24.137764 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: Accept-Encoding: gzip, deflate Aug 09 02:34:24.137764 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: Connection: keep-alive Aug 09 02:34:24.137764 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: Content-Length: 0 Aug 09 02:34:24.137764 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: Host: 10.222.0.20 Aug 09 02:34:24.137764 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: Openstack-Api-Version: compute 2.90 Aug 09 02:34:24.137764 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: Openstack-System-Scope: None Aug 09 02:34:24.137764 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: User-Agent: python-novaclient Aug 09 02:34:24.137764 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: X-Auth-Token: gAAAAABi8cevoXfe3nTAvgZFzRIZa7XlwaZAlrE_SJTQvKtrInuwxQNPjAuvjy5Mx-ayhMl1r7q43MjF0B0LbXDNW_BAsQtNoVyXM3kpG6APT7RVIULKza54Z0MevPZAYVlURZvLqGymYLSAjbVEDeBPnvqYJM3lKC_B2TvMMxNIlbhE9516IXo Aug 09 02:34:24.137764 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: X-Domain-Id: None Aug 09 02:34:24.137764 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: X-Domain-Name: None Aug 09 02:34:24.137764 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: X-Identity-Status: Confirmed Aug 09 02:34:24.137764 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: X-Is-Admin-Project: True Aug 09 02:34:24.137764 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 02:34:24.137764 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: X-Project-Domain-Id: default Aug 09 02:34:24.137764 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: X-Project-Domain-Name: Default Aug 09 02:34:24.137764 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: X-Project-Id: aaeb91952f2c4c9f8cf8e3a10b5518c9 Aug 09 02:34:24.137764 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: X-Project-Name: admin Aug 09 02:34:24.137764 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: X-Role: reader,member,admin Aug 09 02:34:24.137764 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: X-Roles: reader,member,admin Aug 09 02:34:24.139305 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aaeb91952f2c4c9f8cf8e3a10b5518c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aaeb91952f2c4c9f8cf8e3a10b5518c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aaeb91952f2c4c9f8cf8e3a10b5518c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aaeb91952f2c4c9f8cf8e3a10b5518c9"}]}] Aug 09 02:34:24.139305 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: X-Tenant: admin Aug 09 02:34:24.139305 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: X-Tenant-Id: aaeb91952f2c4c9f8cf8e3a10b5518c9 Aug 09 02:34:24.139305 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: X-Tenant-Name: admin Aug 09 02:34:24.139305 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: X-User: admin Aug 09 02:34:24.139305 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: X-User-Domain-Id: default Aug 09 02:34:24.139305 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: X-User-Domain-Name: Default Aug 09 02:34:24.139305 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: X-User-Id: b1cb94a6532045fc84cecdb848b352fb Aug 09 02:34:24.139305 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: X-User-Name: admin Aug 09 02:34:24.139305 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: method: > Aug 09 02:34:24.139305 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: exception: Flavor 451 could not be found. Aug 09 02:34:24.139305 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: action_args: {'id': '451'} Aug 09 02:34:24.139305 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: {{(pid=109914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 02:34:24.139305 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:34:24.140164 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 02:34:24.140164 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 02:34:24.140164 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 02:34:24.140164 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 02:34:24.140164 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 02:34:24.140164 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 02:34:24.140164 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 02:34:24.140164 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 02:34:24.140164 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 02:34:24.140164 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 02:34:24.140164 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 02:34:24.140164 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 02:34:24.140164 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 09 02:34:24.140164 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi Aug 09 02:34:24.140164 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:34:24.140164 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi Aug 09 02:34:24.140164 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:34:24.140164 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:34:24.140164 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:34:24.141262 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 02:34:24.141262 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 02:34:24.141262 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 02:34:24.141262 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 02:34:24.141262 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 02:34:24.141262 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 02:34:24.141262 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 09 02:34:24.141262 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi Aug 09 02:34:24.141262 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:34:24.141262 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi Aug 09 02:34:24.141262 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:34:24.141262 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:34:24.141262 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:34:24.141262 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 02:34:24.141262 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 02:34:24.141262 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 09 02:34:24.141262 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: ERROR nova.api.openstack.wsgi Aug 09 02:34:24.141262 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi [None req-e87d749d-be28-4c5d-9177-324d40914e5c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 02:34:24.142325 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: INFO nova.api.openstack.requestlog [None req-e87d749d-be28-4c5d-9177-324d40914e5c admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.015789 Aug 09 02:34:24.142325 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: [pid: 109914|app: 0|req: 27/52] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Aug 9 02:34:24 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 09 02:34:25.264723 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi [None req-e4ccca66-cf83-4434-9c93-ea28dd158743 admin admin] Calling method '>' {{(pid=109913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:34:25.265724 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: INFO nova.api.openstack.requestlog [None req-e4ccca66-cf83-4434-9c93-ea28dd158743 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Aug 09 02:34:25.266115 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: [pid: 109913|app: 0|req: 26/53] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Aug 9 02:34:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:34:25.810547 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi [None req-09c9bb20-372d-4783-9ace-d1e71a5fa913 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:34:25.832321 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: INFO nova.api.openstack.requestlog [None req-09c9bb20-372d-4783-9ace-d1e71a5fa913 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.430626 Aug 09 02:34:25.832884 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: [pid: 109914|app: 0|req: 28/54] 10.222.0.20 () {64 vars in 1235 bytes} [Tue Aug 9 02:34:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 02:34:26.821934 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi [None req-e4ccca66-cf83-4434-9c93-ea28dd158743 admin admin] Calling method '>' {{(pid=109913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:34:26.822997 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: INFO nova.api.openstack.requestlog [None req-e4ccca66-cf83-4434-9c93-ea28dd158743 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Aug 09 02:34:26.823378 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: [pid: 109913|app: 0|req: 27/55] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Aug 9 02:34:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:34:27.384668 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi [None req-2de40ad0-f15d-479c-aa81-80b270dca81a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:34:27.407642 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: INFO nova.api.openstack.requestlog [None req-2de40ad0-f15d-479c-aa81-80b270dca81a admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.448344 Aug 09 02:34:27.408537 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: [pid: 109914|app: 0|req: 29/56] 10.222.0.20 () {64 vars in 1235 bytes} [Tue Aug 9 02:34:26 2022] POST /compute/v2.1/flavors => generated 405 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 02:34:28.382468 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi [None req-e4ccca66-cf83-4434-9c93-ea28dd158743 admin admin] Calling method '>' {{(pid=109913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:34:28.383476 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: INFO nova.api.openstack.requestlog [None req-e4ccca66-cf83-4434-9c93-ea28dd158743 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Aug 09 02:34:28.383834 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: [pid: 109913|app: 0|req: 28/57] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Aug 9 02:34:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:34:28.960039 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi [None req-f3f76da9-0495-4735-a61b-e2677c57a39a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:34:28.981766 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: INFO nova.api.openstack.requestlog [None req-f3f76da9-0495-4735-a61b-e2677c57a39a admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.454714 Aug 09 02:34:28.982349 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: [pid: 109914|app: 0|req: 30/58] 10.222.0.20 () {64 vars in 1235 bytes} [Tue Aug 9 02:34:28 2022] POST /compute/v2.1/flavors => generated 407 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 02:34:29.980381 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi [None req-e4ccca66-cf83-4434-9c93-ea28dd158743 admin admin] Calling method '>' {{(pid=109913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:34:29.981383 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: INFO nova.api.openstack.requestlog [None req-e4ccca66-cf83-4434-9c93-ea28dd158743 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001546 Aug 09 02:34:29.981768 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: [pid: 109913|app: 0|req: 29/59] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Aug 9 02:34:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:34:30.553823 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi [None req-a1582035-4740-48f4-b50f-d9c7edbc31e5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:34:30.575969 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: INFO nova.api.openstack.requestlog [None req-a1582035-4740-48f4-b50f-d9c7edbc31e5 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.457205 Aug 09 02:34:30.576540 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: [pid: 109914|app: 0|req: 31/60] 10.222.0.20 () {64 vars in 1235 bytes} [Tue Aug 9 02:34:30 2022] POST /compute/v2.1/flavors => generated 409 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 02:34:31.569229 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi [None req-e4ccca66-cf83-4434-9c93-ea28dd158743 admin admin] Calling method '>' {{(pid=109913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:34:31.570283 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: INFO nova.api.openstack.requestlog [None req-e4ccca66-cf83-4434-9c93-ea28dd158743 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Aug 09 02:34:31.570666 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: [pid: 109913|app: 0|req: 30/61] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Aug 9 02:34:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:34:32.123956 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi [None req-20f34c22-9e6e-47f6-a188-5b0d307bce0d admin admin] Calling method '>' {{(pid=109914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:34:32.145088 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: INFO nova.api.openstack.requestlog [None req-20f34c22-9e6e-47f6-a188-5b0d307bce0d admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.432761 Aug 09 02:34:32.145818 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: [pid: 109914|app: 0|req: 32/62] 10.222.0.20 () {60 vars in 1202 bytes} [Tue Aug 9 02:34:31 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:35:23.366964 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi [None req-e4ccca66-cf83-4434-9c93-ea28dd158743 admin admin] Calling method '>' {{(pid=109913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:35:23.367950 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: INFO nova.api.openstack.requestlog [None req-e4ccca66-cf83-4434-9c93-ea28dd158743 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Aug 09 02:35:23.368340 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: [pid: 109913|app: 0|req: 31/63] 10.222.0.20 () {54 vars in 931 bytes} [Tue Aug 9 02:35:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:35:23.381196 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG dbcounter [-] [109914] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=109914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:35:23.807886 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi [None req-fd527480-5483-41d1-8008-53037bb92720 admin admin] Calling method '>' {{(pid=109914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:35:23.829343 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: INFO nova.api.openstack.requestlog [None req-fd527480-5483-41d1-8008-53037bb92720 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.454887 Aug 09 02:35:23.829849 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: [pid: 109914|app: 0|req: 33/64] 10.222.0.20 () {60 vars in 1292 bytes} [Tue Aug 9 02:35:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:35:23.853702 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi [None req-25bd5b10-a195-452c-8983-0fdb20f9c076 admin admin] Calling method '>' {{(pid=109913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:35:23.857276 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG dbcounter [-] [109913] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=109913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:35:23.863460 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: INFO nova.api.openstack.requestlog [None req-25bd5b10-a195-452c-8983-0fdb20f9c076 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013788 Aug 09 02:35:23.863994 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: [pid: 109913|app: 0|req: 32/65] 10.222.0.20 () {60 vars in 1283 bytes} [Tue Aug 9 02:35:23 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:35:23.876213 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi [None req-c3f84244-a0ae-4810-9d49-cadbdbdf4663 admin admin] Calling method '>' {{(pid=109914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:35:23.884039 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: INFO nova.api.openstack.requestlog [None req-c3f84244-a0ae-4810-9d49-cadbdbdf4663 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011512 Aug 09 02:35:23.884516 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: [pid: 109914|app: 0|req: 34/66] 10.222.0.20 () {60 vars in 1286 bytes} [Tue Aug 9 02:35:23 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:35:23.898139 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi [None req-38d3a661-c961-4423-967b-c89c980c5d0c admin admin] Calling method '>' {{(pid=109913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:35:23.906609 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: INFO nova.api.openstack.requestlog [None req-38d3a661-c961-4423-967b-c89c980c5d0c admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012303 Aug 09 02:35:23.907153 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: [pid: 109913|app: 0|req: 33/67] 10.222.0.20 () {60 vars in 1286 bytes} [Tue Aug 9 02:35:23 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:35:23.921385 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi [None req-352ccd59-1412-4176-81dc-5956e8e07444 admin admin] Calling method '>' {{(pid=109914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:35:23.932885 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: INFO nova.api.openstack.requestlog [None req-352ccd59-1412-4176-81dc-5956e8e07444 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.016983 Aug 09 02:35:23.933584 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: [pid: 109914|app: 0|req: 35/68] 10.222.0.20 () {60 vars in 1283 bytes} [Tue Aug 9 02:35:23 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:38:28.941456 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi [None req-38d3a661-c961-4423-967b-c89c980c5d0c admin admin] Calling method '>' {{(pid=109913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:38:28.942525 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: INFO nova.api.openstack.requestlog [None req-38d3a661-c961-4423-967b-c89c980c5d0c admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Aug 09 02:38:28.942911 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: [pid: 109913|app: 0|req: 34/69] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Aug 9 02:38:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:38:29.082486 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG dbcounter [-] [109914] Writing DB stats nova_api:SELECT=6 {{(pid=109914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:38:29.253356 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi [None req-4e1415ca-818f-4385-865b-20b680b4010a admin admin] Calling method '>' {{(pid=109914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:38:29.255923 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 02:38:29.255923 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: warnings.warn(msg) Aug 09 02:38:29.257130 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG oslo_concurrency.lockutils [None req-4e1415ca-818f-4385-865b-20b680b4010a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=109914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:38:29.257589 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG oslo_concurrency.lockutils [None req-4e1415ca-818f-4385-865b-20b680b4010a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:38:29.258006 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG oslo_concurrency.lockutils [None req-4e1415ca-818f-4385-865b-20b680b4010a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:38:29.258726 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG oslo_concurrency.lockutils [None req-4e1415ca-818f-4385-865b-20b680b4010a admin admin] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=109914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:38:29.259154 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG oslo_concurrency.lockutils [None req-4e1415ca-818f-4385-865b-20b680b4010a admin admin] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:38:29.259558 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG oslo_concurrency.lockutils [None req-4e1415ca-818f-4385-865b-20b680b4010a admin admin] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:38:29.292888 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: INFO nova.api.openstack.requestlog [None req-4e1415ca-818f-4385-865b-20b680b4010a admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.213203 Aug 09 02:38:29.293424 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: [pid: 109914|app: 0|req: 36/70] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Aug 9 02:38:29 2022] GET /compute/v2.1/os-services => generated 791 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 02:38:30.128307 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi [None req-38d3a661-c961-4423-967b-c89c980c5d0c admin admin] Calling method '>' {{(pid=109913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:38:30.129309 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: INFO nova.api.openstack.requestlog [None req-38d3a661-c961-4423-967b-c89c980c5d0c admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Aug 09 02:38:30.129717 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: [pid: 109913|app: 0|req: 35/71] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Aug 9 02:38:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:38:30.327866 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi [None req-8c53f51e-832c-4963-9ae1-ac62d0a13ccc admin admin] Calling method '>' {{(pid=109914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:38:30.330339 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 02:38:30.330339 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: warnings.warn(msg) Aug 09 02:38:30.331376 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG oslo_concurrency.lockutils [None req-8c53f51e-832c-4963-9ae1-ac62d0a13ccc admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=109914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:38:30.331846 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG oslo_concurrency.lockutils [None req-8c53f51e-832c-4963-9ae1-ac62d0a13ccc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:38:30.332263 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG oslo_concurrency.lockutils [None req-8c53f51e-832c-4963-9ae1-ac62d0a13ccc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:38:30.332961 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG oslo_concurrency.lockutils [None req-8c53f51e-832c-4963-9ae1-ac62d0a13ccc admin admin] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=109914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:38:30.333394 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG oslo_concurrency.lockutils [None req-8c53f51e-832c-4963-9ae1-ac62d0a13ccc admin admin] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:38:30.333796 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG oslo_concurrency.lockutils [None req-8c53f51e-832c-4963-9ae1-ac62d0a13ccc admin admin] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:38:30.354117 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: INFO nova.api.openstack.requestlog [None req-8c53f51e-832c-4963-9ae1-ac62d0a13ccc admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.081704 Aug 09 02:38:30.354691 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: [pid: 109914|app: 0|req: 37/72] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Aug 9 02:38:30 2022] GET /compute/v2.1/os-services => generated 791 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 02:38:41.611105 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi [None req-38d3a661-c961-4423-967b-c89c980c5d0c admin admin] Calling method '>' {{(pid=109913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:38:41.612100 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: INFO nova.api.openstack.requestlog [None req-38d3a661-c961-4423-967b-c89c980c5d0c admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Aug 09 02:38:41.612482 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: [pid: 109913|app: 0|req: 36/73] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Aug 9 02:38:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:38:41.759660 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG dbcounter [-] [109914] Writing DB stats nova_cell0:SELECT=4 {{(pid=109914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:38:41.760372 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG dbcounter [-] [109914] Writing DB stats nova_cell1:SELECT=4 {{(pid=109914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:38:41.761310 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG dbcounter [-] [109914] Writing DB stats nova_api:SELECT=8 {{(pid=109914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:38:41.812135 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi [None req-41c0e9bc-e64e-453f-86f1-b8dde9f8fda6 admin admin] Calling method '>' {{(pid=109914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:38:41.814528 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 02:38:41.814528 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: warnings.warn(msg) Aug 09 02:38:41.815647 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG oslo_concurrency.lockutils [None req-41c0e9bc-e64e-453f-86f1-b8dde9f8fda6 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=109914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:38:41.816111 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG oslo_concurrency.lockutils [None req-41c0e9bc-e64e-453f-86f1-b8dde9f8fda6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:38:41.816566 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG oslo_concurrency.lockutils [None req-41c0e9bc-e64e-453f-86f1-b8dde9f8fda6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:38:41.817261 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG oslo_concurrency.lockutils [None req-41c0e9bc-e64e-453f-86f1-b8dde9f8fda6 admin admin] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=109914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:38:41.817691 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG oslo_concurrency.lockutils [None req-41c0e9bc-e64e-453f-86f1-b8dde9f8fda6 admin admin] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:38:41.818080 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG oslo_concurrency.lockutils [None req-41c0e9bc-e64e-453f-86f1-b8dde9f8fda6 admin admin] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:38:41.842540 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: INFO nova.api.openstack.requestlog [None req-41c0e9bc-e64e-453f-86f1-b8dde9f8fda6 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.090506 Aug 09 02:38:41.843079 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: [pid: 109914|app: 0|req: 38/74] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Aug 9 02:38:41 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:38:42.691096 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: DEBUG nova.api.openstack.wsgi [None req-38d3a661-c961-4423-967b-c89c980c5d0c admin admin] Calling method '>' {{(pid=109913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:38:42.692138 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: INFO nova.api.openstack.requestlog [None req-38d3a661-c961-4423-967b-c89c980c5d0c admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Aug 09 02:38:42.692535 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: [pid: 109913|app: 0|req: 37/75] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Aug 9 02:38:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:38:42.886587 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG nova.api.openstack.wsgi [None req-1b6ef57a-69a0-4312-beae-ae92d5bfd3e2 admin admin] Calling method '>' {{(pid=109914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:38:42.889118 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 02:38:42.889118 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: warnings.warn(msg) Aug 09 02:38:42.890238 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG oslo_concurrency.lockutils [None req-1b6ef57a-69a0-4312-beae-ae92d5bfd3e2 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=109914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:38:42.890694 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG oslo_concurrency.lockutils [None req-1b6ef57a-69a0-4312-beae-ae92d5bfd3e2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:38:42.891112 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG oslo_concurrency.lockutils [None req-1b6ef57a-69a0-4312-beae-ae92d5bfd3e2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:38:42.891890 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG oslo_concurrency.lockutils [None req-1b6ef57a-69a0-4312-beae-ae92d5bfd3e2 admin admin] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=109914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:38:42.892330 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG oslo_concurrency.lockutils [None req-1b6ef57a-69a0-4312-beae-ae92d5bfd3e2 admin admin] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:38:42.892728 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: DEBUG oslo_concurrency.lockutils [None req-1b6ef57a-69a0-4312-beae-ae92d5bfd3e2 admin admin] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:38:42.914053 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: INFO nova.api.openstack.requestlog [None req-1b6ef57a-69a0-4312-beae-ae92d5bfd3e2 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.087121 Aug 09 02:38:42.914633 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: [pid: 109914|app: 0|req: 39/76] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Aug 9 02:38:42 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:39:38.088625 dv-cinder-852461-1-iscsi devstack@n-api.service[109912]: Tue Aug 9 02:39:38 2022 - graceful shutdown triggered... Aug 09 02:39:38.088508 dv-cinder-852461-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 09 02:39:38.089622 dv-cinder-852461-1-iscsi devstack@n-api.service[109913]: Gracefully killing worker 1 (pid: 109913)... Aug 09 02:39:38.089994 dv-cinder-852461-1-iscsi devstack@n-api.service[109914]: Gracefully killing worker 2 (pid: 109914)... Aug 09 02:39:39.089459 dv-cinder-852461-1-iscsi devstack@n-api.service[109912]: worker 1 buried after 1 seconds Aug 09 02:39:39.089459 dv-cinder-852461-1-iscsi devstack@n-api.service[109912]: worker 2 buried after 1 seconds Aug 09 02:39:39.089459 dv-cinder-852461-1-iscsi devstack@n-api.service[109912]: goodbye to uWSGI. Aug 09 02:39:39.091984 dv-cinder-852461-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 09 02:39:39.092879 dv-cinder-852461-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 09 02:39:39.097463 dv-cinder-852461-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 09 02:39:39.107737 dv-cinder-852461-1-iscsi devstack@n-api.service[124411]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 09 02:39:39.111034 dv-cinder-852461-1-iscsi devstack@n-api.service[124411]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 9 02:39:39 2022] *** Aug 09 02:39:39.111034 dv-cinder-852461-1-iscsi devstack@n-api.service[124411]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 09 02:39:39.111034 dv-cinder-852461-1-iscsi devstack@n-api.service[124411]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 09 02:39:39.111034 dv-cinder-852461-1-iscsi devstack@n-api.service[124411]: nodename: dv-cinder-852461-1-iscsi Aug 09 02:39:39.111034 dv-cinder-852461-1-iscsi devstack@n-api.service[124411]: machine: x86_64 Aug 09 02:39:39.111034 dv-cinder-852461-1-iscsi devstack@n-api.service[124411]: clock source: unix Aug 09 02:39:39.111034 dv-cinder-852461-1-iscsi devstack@n-api.service[124411]: pcre jit disabled Aug 09 02:39:39.111034 dv-cinder-852461-1-iscsi devstack@n-api.service[124411]: detected number of CPU cores: 4 Aug 09 02:39:39.111034 dv-cinder-852461-1-iscsi devstack@n-api.service[124411]: current working directory: / Aug 09 02:39:39.111034 dv-cinder-852461-1-iscsi devstack@n-api.service[124411]: detected binary path: /usr/bin/uwsgi-core Aug 09 02:39:39.111034 dv-cinder-852461-1-iscsi devstack@n-api.service[124411]: your processes number limit is 47680 Aug 09 02:39:39.111873 dv-cinder-852461-1-iscsi devstack@n-api.service[124411]: your memory page size is 4096 bytes Aug 09 02:39:39.111873 dv-cinder-852461-1-iscsi devstack@n-api.service[124411]: detected max file descriptor number: 2048 Aug 09 02:39:39.111873 dv-cinder-852461-1-iscsi devstack@n-api.service[124411]: lock engine: pthread robust mutexes Aug 09 02:39:39.111873 dv-cinder-852461-1-iscsi devstack@n-api.service[124411]: thunder lock: enabled Aug 09 02:39:39.111873 dv-cinder-852461-1-iscsi devstack@n-api.service[124411]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 09 02:39:39.111873 dv-cinder-852461-1-iscsi devstack@n-api.service[124411]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 09 02:39:39.153308 dv-cinder-852461-1-iscsi devstack@n-api.service[124411]: Python main interpreter initialized at 0x55bbb9ed59c0 Aug 09 02:39:39.153308 dv-cinder-852461-1-iscsi devstack@n-api.service[124411]: python threads support enabled Aug 09 02:39:39.153308 dv-cinder-852461-1-iscsi devstack@n-api.service[124411]: your server socket listen backlog is limited to 100 connections Aug 09 02:39:39.153308 dv-cinder-852461-1-iscsi devstack@n-api.service[124411]: your mercy for graceful operations on workers is 90 seconds Aug 09 02:39:39.153791 dv-cinder-852461-1-iscsi devstack@n-api.service[124411]: mapped 403077 bytes (393 KB) for 2 cores Aug 09 02:39:39.153791 dv-cinder-852461-1-iscsi devstack@n-api.service[124411]: *** Operational MODE: preforking *** Aug 09 02:39:39.154016 dv-cinder-852461-1-iscsi devstack@n-api.service[124411]: *** uWSGI is running in multiple interpreter mode *** Aug 09 02:39:39.154016 dv-cinder-852461-1-iscsi devstack@n-api.service[124411]: spawned uWSGI master process (pid: 124411) Aug 09 02:39:39.154264 dv-cinder-852461-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 09 02:39:39.154817 dv-cinder-852461-1-iscsi devstack@n-api.service[124411]: spawned uWSGI worker 1 (pid: 124425, cores: 1) Aug 09 02:39:39.155155 dv-cinder-852461-1-iscsi devstack@n-api.service[124411]: spawned uWSGI worker 2 (pid: 124427, cores: 1) Aug 09 02:39:39.155522 dv-cinder-852461-1-iscsi devstack@n-api.service[124411]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 09 02:39:39.804395 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 09 02:39:39.807025 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 09 02:39:40.937627 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 02:39:40.937627 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: from cryptography.utils import int_from_bytes Aug 09 02:39:40.938373 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 02:39:40.938373 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: from cryptography.utils import int_from_bytes Aug 09 02:39:40.947744 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 02:39:40.947744 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: from cryptography.utils import int_from_bytes Aug 09 02:39:40.948298 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 02:39:40.948298 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: from cryptography.utils import int_from_bytes Aug 09 02:39:43.283987 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 09 02:39:43.284696 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 09 02:39:43.284696 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 09 02:39:43.284990 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 09 02:39:43.285362 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 09 02:39:43.285458 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 09 02:39:43.285551 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 09 02:39:43.285632 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 09 02:39:43.285721 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.286008 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 09 02:39:43.286180 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.286297 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 09 02:39:43.286382 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.286678 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.286819 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.287000 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.287193 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.287280 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.287360 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.287592 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.287703 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.287927 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.288071 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.288252 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.288380 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.288471 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.288551 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.288770 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.288892 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.289086 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852461-1-iscsi {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.289193 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.289391 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.289498 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.289700 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.289820 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.290006 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.290113 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852461-1-iscsi {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.290357 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.290478 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.290660 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.290766 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.290970 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.291066 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.291285 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.291392 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.291590 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.291783 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.291901 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.292246 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.292725 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.293064 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.293341 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.293588 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.293792 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.294008 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.294271 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.294491 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.294723 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.294938 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.295140 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.295350 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.295565 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.295765 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.295983 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.296204 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.296405 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.296616 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.296832 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.297041 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.297249 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852461-1-iscsi {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.297459 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.297666 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.297883 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852461-1-iscsi {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.298095 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.298316 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.298489 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.298673 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.298673 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.299014 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.299014 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.299377 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.299583 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.299785 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.299980 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.300132 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.300274 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.300424 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.300585 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.300746 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.300939 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.301100 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.301283 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.301454 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.301603 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.301772 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.301917 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.302066 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.302269 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.303111 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.303273 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.303439 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.303592 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.303756 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.303943 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.304129 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.304274 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.304432 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.304581 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.304721 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.304872 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.305020 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.305176 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.305320 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.305461 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.305621 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.305763 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.305903 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.306056 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.306253 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.306400 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.306549 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.306694 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.306849 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.307006 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.307157 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.307319 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.307473 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.307623 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.307774 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.307917 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.308057 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.308209 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.308359 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.308514 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.308655 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.308802 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.308949 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.309110 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.309292 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.309447 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.309598 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.309750 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.309890 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.310036 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.310211 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.310379 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.310530 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.310672 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.310822 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.310971 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.311140 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.311290 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.311432 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.311432 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.311704 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.311704 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.311988 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.312138 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.312318 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.312470 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.313260 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.313415 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.313573 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.313737 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.313886 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.314045 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.314213 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.314359 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.314509 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.314658 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.314799 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.314939 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.315085 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.315233 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.315384 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.315384 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.315668 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.315810 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.316094 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.316094 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.316411 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.316561 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.316703 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.316703 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.316977 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.317131 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.317281 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.317423 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.317575 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.317729 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.317879 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.318119 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.318308 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.318462 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.318623 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.318764 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.318914 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.319064 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.319211 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.319394 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.319539 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.319691 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.319832 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.319983 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.320161 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.320313 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.320464 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.320604 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.320759 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.320917 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.321068 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.321218 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.321365 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.321514 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.324773 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.324953 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.325110 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.325806 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.325916 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.325996 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.326082 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.326194 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.326298 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.326382 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.326463 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.326548 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.326635 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.326716 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.326795 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.326876 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.326955 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.327027 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.327106 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.327179 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.327259 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.327338 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.327411 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.327489 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.327573 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.327646 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.327717 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.327788 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.327860 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.327945 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.328025 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.328104 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.328182 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.328253 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.328325 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.328404 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.328491 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.328563 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.328640 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.328712 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.328790 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.328876 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.328955 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.329027 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.329104 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.329182 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.329261 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.329355 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.329430 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.329430 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.329567 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.329645 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.329730 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.329802 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.329877 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.329949 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.330029 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.330101 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.330207 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.330293 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.330371 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.330449 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.330526 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.330598 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.330676 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.330764 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.330838 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.330923 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.331011 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.331095 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.331191 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:39:43.331277 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.331360 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.331450 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.331562 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.331649 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.331723 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.331801 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.331885 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.331975 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.332068 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.332162 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.332247 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.332345 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.332438 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.332533 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.332625 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.332723 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.332808 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.332891 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.332982 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.333073 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.333170 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.333261 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.333346 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.333438 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.333522 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.333612 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.333709 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.333807 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.333908 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.334001 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.334092 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.334193 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.334268 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.334352 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.334426 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.334497 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.334574 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.338204 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.338397 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.338397 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.338713 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.338868 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.339032 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.339176 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.339325 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.339526 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.339675 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.339825 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.339974 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.340115 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.340256 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.340412 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.340553 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.340702 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.340852 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.341014 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.341168 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.341309 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.341459 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.341600 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.341749 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.341891 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.342040 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.342256 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.342405 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.342546 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.342687 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.342834 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.343055 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.343199 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.343347 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.343488 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.343628 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.343768 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.343916 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.344066 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.344214 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.344900 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.345140 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.345296 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.345460 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.345603 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.345744 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.345892 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.346033 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.346217 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.346371 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.346521 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.346670 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.346811 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.346959 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.347113 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.347342 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.347502 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.347652 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.347800 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.347948 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.348098 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.348248 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.348396 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.348543 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.348694 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.348845 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.349006 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.349156 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.349298 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.349450 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.349642 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.349802 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.349951 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.350100 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.350274 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.350426 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.350576 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.350726 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.350868 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.351015 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.351163 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.351304 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.351462 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.351612 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.351760 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.352264 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.352415 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.352556 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.352695 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.352849 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.352997 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.353148 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.353296 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.353444 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.353594 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.353752 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.353893 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.354033 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.354198 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.354345 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.355030 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.355272 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.355421 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.355572 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.355722 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.355864 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.356013 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.356165 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.356306 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.356455 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.356605 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.356746 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.356897 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.357046 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.357194 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.357343 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.357485 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.357641 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.357791 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.357939 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.358091 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.358851 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.359014 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.359168 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.359311 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.359453 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.359595 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.359778 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.359923 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.360079 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.360230 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.360378 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.360519 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.360680 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.360831 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.360982 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.361124 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.361265 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.361405 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.361552 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.361706 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.361855 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.361997 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.362137 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.362316 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.362477 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.362634 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.362783 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.362969 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.363120 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.363269 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.363411 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.363561 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.363708 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.363849 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.364006 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.364147 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.364294 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.364456 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.365073 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.365320 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.365554 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.365700 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.365851 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.366002 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.366169 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.366318 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.366470 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.366619 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.366769 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.366910 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.367075 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.367226 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.367375 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.367517 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.367677 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.367826 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.367967 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.368125 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.368331 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.368482 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.368644 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.368798 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.368940 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.369093 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.369243 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.369399 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.369554 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.369702 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.369890 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.370042 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.370271 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.370440 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.370440 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.370723 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.370872 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.371038 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.371333 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.371512 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.371671 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.371821 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.371968 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.372124 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.372281 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.372438 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.372586 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.372744 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.372901 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.373064 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.373236 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.373385 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.373539 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.373695 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.373842 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.373997 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.374237 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.374402 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.374558 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.375140 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.375319 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.375575 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.375815 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.375989 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.376145 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.376302 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.376456 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.376613 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.376770 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.376925 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.377073 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.377837 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.377997 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.378146 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.378351 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.378590 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.378764 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.378942 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.379201 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.379383 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.379566 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.379718 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.379905 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.380064 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.380221 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.380384 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.380532 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.380692 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.380840 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.381000 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.381163 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.381417 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.381593 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.381746 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.381904 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.382052 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.382227 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.382394 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.382544 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.382698 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.382848 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.383002 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.383180 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.383337 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.383485 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.383632 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.383786 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.384548 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.384706 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.385441 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.385720 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.386276 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.386444 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.386607 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.386764 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.386912 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.387071 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.387227 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.387384 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.387549 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.387698 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.387855 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.388014 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.388162 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.388317 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.388473 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.388647 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.388800 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.388958 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.389117 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.389277 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.389434 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.389591 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.389746 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.389907 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.390112 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.390304 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.390456 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.390614 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.390771 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.390920 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.391067 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.391216 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.391216 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.391515 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.391672 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.391828 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.391828 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.392125 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.392125 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.392415 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.392582 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.392741 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.392889 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.393044 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.393191 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.393339 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.393499 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.393648 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.393803 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.393951 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.394138 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.394368 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.394518 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.394686 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.394842 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.395000 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.395678 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.395954 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.396110 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.396283 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.396532 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.396695 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.396843 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.397014 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.397172 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.397574 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.397741 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.397896 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.398055 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.398252 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.398415 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.398551 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.398886 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.399040 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.399209 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.399358 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.399488 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.399578 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.399683 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.399777 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.399878 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.399974 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.399974 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.400205 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.400205 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.400373 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.400373 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.400545 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.400638 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.400724 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.400818 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.400935 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.400935 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.401108 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.401108 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.401273 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.401273 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.401474 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.401474 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.401641 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.401641 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.401818 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.401905 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.401998 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.402095 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.402218 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.402306 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.402409 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.402496 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.402588 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.402683 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.402768 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.402853 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.402937 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.403021 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.403105 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.403197 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.403290 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.403376 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.403467 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.403559 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.403644 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.403758 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.403846 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.403930 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.404014 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.404105 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.404273 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.404362 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.404454 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.404540 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.404625 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.404709 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.404804 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.404891 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.404976 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.405069 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.405159 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.405801 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.405906 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.406014 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.406096 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.406297 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.406380 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.406453 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.406570 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.406656 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.406730 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.406803 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.406882 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.406963 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.407045 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.407126 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.407206 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.407289 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.407368 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.407449 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.407522 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.407593 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.407664 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.408247 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.408333 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.408421 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.408495 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.408568 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.408644 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.408717 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.408805 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.408886 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.408968 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.409054 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.409129 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.409208 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.409369 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.409445 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.409524 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.409598 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.409728 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.409937 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.410026 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.410108 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.410227 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.410311 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.410392 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.410473 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.410555 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.410636 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.410709 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.410787 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.410869 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.410954 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.411028 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.411099 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.411172 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.411243 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.411314 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.411399 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.411479 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.411552 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.411623 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.411696 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.411768 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.411851 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.411930 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.412002 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.412080 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.412152 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.412268 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.412363 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.412445 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.412518 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.412589 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.412667 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.412753 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.412826 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.412898 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.412983 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.413056 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.413128 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.413208 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.413281 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.413418 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.413539 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.413650 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.413769 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.413894 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.414008 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.414117 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.414261 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.414261 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.414480 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.414599 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.414718 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.414718 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.414940 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.415060 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.415178 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.415178 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.415406 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.415535 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.416109 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.416230 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.416373 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.416571 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.416694 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.416813 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.416923 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.417040 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.417165 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.417276 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.417387 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.418071 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.418388 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.418535 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.418665 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.418797 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.418924 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.419060 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.419188 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.419328 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.419457 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.419593 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.419731 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.419859 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.419859 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.420111 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.420271 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.420399 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.420399 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.420630 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.420751 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.420854 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.420950 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.421036 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.421120 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.421204 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.421303 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.421384 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.421384 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.421522 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.421600 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.421672 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.421752 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.421854 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.421931 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.422003 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.422081 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.422180 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.422268 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.422342 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.422414 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.422484 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.422563 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.422644 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.422716 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.422795 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.422873 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.422952 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.422952 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.423102 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.423175 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.423245 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.423324 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.423324 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.423324 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.423518 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.423597 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.423669 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.423739 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.423810 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.423880 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.423960 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.424039 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.424117 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.424195 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.424395 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.424503 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.424629 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.424733 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.424938 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.425019 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.425248 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.425367 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.425703 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.426022 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.426364 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.426681 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.426896 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.427053 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.427245 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.427394 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.427580 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.427727 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.427885 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.428031 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.428187 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.428327 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.428559 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.428700 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.428852 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.428999 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.429135 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.429272 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.429412 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.429557 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.429707 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.429855 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.430008 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.430145 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.430444 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.430759 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.431079 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.431208 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.431392 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.431567 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.431701 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.432011 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.432106 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.432422 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.432521 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.432749 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.432852 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.433063 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.433162 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.433376 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.433468 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.433693 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.433794 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.434014 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.434108 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.434363 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.434464 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.434676 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.434781 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.434986 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.435088 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.435403 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.435494 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.435718 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.435811 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.436222 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.436325 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.436325 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.436492 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.436625 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.436742 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.436932 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.437035 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.437243 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.437337 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.437548 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.437653 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.437855 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.437947 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.438181 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.438324 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.438507 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.438640 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.438810 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.438905 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.439116 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.439215 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.439441 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.439544 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.439839 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.439938 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.440149 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.440242 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.440472 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.440564 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.440869 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.440989 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.441289 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.441388 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.441606 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.441700 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.441929 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.442030 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.442275 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.442418 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.442581 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.442699 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.442897 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.443002 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.443207 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.443368 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.443519 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.443612 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.443841 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.443931 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.444154 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.444248 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.444471 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.444565 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.444776 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.444871 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.445086 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.445185 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.445407 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.445499 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.445722 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.445824 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.446044 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.446146 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.446463 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.446556 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.446788 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.446897 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.447103 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.447208 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.447414 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.447507 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.447737 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.447842 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.448044 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.448137 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.448349 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.448442 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.448654 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.448759 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.448960 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.449051 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.449266 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.449357 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.449579 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.449680 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.449881 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.449972 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.450213 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.450311 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.450527 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.450620 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.450837 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.450928 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.451140 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.451288 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.451443 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.451566 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.451749 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.451867 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.452048 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.452171 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.452364 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.452456 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.452671 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.452763 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.452991 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.453091 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.453306 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.453405 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.453609 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.453704 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.453924 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.454096 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.454249 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.454338 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.454546 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.454646 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.454849 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.454952 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.455156 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.455249 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.455461 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.455554 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.455791 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.455895 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.456155 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.456267 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.456448 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.456610 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.456769 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.456863 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.457076 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.457192 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.457400 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.457502 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.457723 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.457823 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.458037 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.458146 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.458381 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.458482 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.458704 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.458805 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.459004 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.459133 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.459306 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.459410 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.459612 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.459710 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.459914 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.460013 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.460219 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.460319 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.460520 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.460618 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.460824 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.460923 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.461124 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.461229 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.461429 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.461528 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.461730 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.461821 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.462035 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.462140 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.462377 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.462470 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.462681 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.462780 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.462989 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.463090 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.463291 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.463392 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.463596 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.463688 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.463896 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.463996 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.464204 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.464295 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.464528 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.464620 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.464840 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.464976 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.465152 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.465243 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.465468 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.465575 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.465784 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.465876 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.466100 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.466244 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.466445 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.466571 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.466761 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.466864 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.467077 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.467168 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.467393 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.467554 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.467708 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.467809 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.468017 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.468110 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.468328 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.468433 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.468646 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.468745 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.468960 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.469051 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.469278 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.469528 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.469844 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.469937 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.470176 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.470305 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.470493 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.470629 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.470808 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.470907 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.471142 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.471276 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.471457 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.471562 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.471746 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.471847 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.472056 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.472148 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.472413 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.472508 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.472727 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.472819 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.473043 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.473144 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.473360 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.473461 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.473683 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.473775 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.474015 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.474117 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.474383 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.474475 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.474704 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.474798 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.475023 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.475130 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.475339 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.475430 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.475655 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.475755 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.475999 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.476093 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.476305 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.476455 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.476614 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.476707 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.477288 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.477401 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.477605 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.477707 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.477917 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.478019 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.478259 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.478372 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.478575 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.478692 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.478888 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.479003 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.479204 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.479330 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.479514 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.479627 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.479824 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.479931 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.480135 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.480227 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.480449 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.480543 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.480777 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.480914 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.481092 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.481192 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.481398 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.481496 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.481713 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.481812 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.482027 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.482120 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.482384 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.482582 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.482895 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.482989 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.483213 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.483303 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.483535 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.483625 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.483858 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.483959 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.484171 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.484271 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.484487 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.484587 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.484808 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.484915 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.485144 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.485241 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.485426 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.485546 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.485704 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.485805 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.486017 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.486198 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.486340 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.486498 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.486644 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.486788 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.486966 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.487111 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.487261 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.487412 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.487548 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.487687 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.487848 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.487942 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.488171 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.488373 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.488711 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.488807 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.489031 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.489130 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.489354 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.489462 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.489687 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.489801 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.489992 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.490087 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.490325 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.490421 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.490650 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.490743 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.490956 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.491062 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.491260 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.491362 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.491565 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.491659 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.491876 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.491983 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.492179 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.492280 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.492481 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.492580 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.492788 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.492891 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.493094 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.493187 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.493396 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.493490 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.493699 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.493798 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.494000 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.494099 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.494341 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.494435 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.494647 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.494747 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.494951 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.495046 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.495265 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.495369 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.495558 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.495651 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.495861 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.495960 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.496163 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.496265 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.496464 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.496556 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.496766 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.496861 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.497068 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.497162 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.497367 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.497460 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.497670 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.497771 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.497969 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.498082 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.498301 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.498408 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.498609 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.498710 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.498917 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.499024 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.499220 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.499314 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.499541 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.499634 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.499847 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.500000 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.500186 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.500278 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.500500 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.500591 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.500807 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.500908 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.501130 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.501224 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.501443 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.501536 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.501752 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.501854 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.502061 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.502171 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.502433 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.502528 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.502755 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.502967 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.503298 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.503400 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.503668 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.503765 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.504002 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.504100 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.504333 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.504433 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.504639 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.504733 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.504944 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.505038 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.505247 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.505396 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.505552 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.505658 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.505872 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.505971 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.506202 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.506298 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.506517 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.506619 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.506829 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.506928 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.507134 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.507275 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.507441 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.507549 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.507750 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.507844 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.508056 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.508158 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.508367 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.508458 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.508676 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.508767 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.508984 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.509085 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.509290 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.509384 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.509598 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.509691 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.509908 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.510044 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.510238 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.510406 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.510548 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.510688 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.510882 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.511036 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.511198 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.511332 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.511514 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.511648 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.511825 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.511971 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.512135 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.512276 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.512438 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.512575 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.512739 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.512975 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.513114 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.513261 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.513407 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.513563 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.513707 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.513857 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.513994 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.514137 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.514255 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.514343 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.514587 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.514680 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.514956 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.515049 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.515273 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.515374 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.515596 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.515692 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.515905 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.516007 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.516215 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.516315 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.516532 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.516626 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.516841 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.516938 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.517204 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.517349 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.517451 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.517538 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.517767 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.517860 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.518099 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.518265 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.518462 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.518563 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.518782 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.518875 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.519120 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.519229 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.519427 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.519518 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.519728 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.519827 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.520034 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.520163 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.520345 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.520457 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.520650 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.520749 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.520952 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.521053 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.521252 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.521356 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.521553 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.521660 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.521853 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.521959 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.522175 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.522288 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.522475 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.522568 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.522777 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.522869 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.523080 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.523172 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.523383 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.523488 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.523682 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.523785 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.523983 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.524083 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.524282 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.524384 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.524581 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.524675 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.524879 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.524971 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.525177 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.525280 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.525474 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.525587 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.525776 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.525885 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.526074 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.526196 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.526400 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.526493 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.526699 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.526792 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.527000 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.527107 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.527400 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.527515 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.527648 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.527740 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.527969 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.528071 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.528281 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.528442 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.528585 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.528725 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.528881 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.529037 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.529183 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.529320 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.529498 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.529646 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.529797 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.529932 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.530113 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.530309 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.530449 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.530569 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.530761 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.530861 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.531071 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.531210 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.531364 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.531489 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.531674 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.531777 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.531981 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.532084 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.532288 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.532394 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.532599 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.532700 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.532921 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.533013 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.533225 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.533326 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.533537 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.533638 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.533852 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.533953 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.534235 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.534340 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.534506 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.534607 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.534875 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.534971 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.535191 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.535286 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.535521 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.535628 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.535833 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.535948 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.536137 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.536228 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.536446 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.536544 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.536752 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.536857 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.537064 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.537188 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.537427 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.537545 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.537684 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.537837 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.537985 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.538078 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.538326 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.538467 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.538645 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.538739 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.538971 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.539063 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.539280 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.539380 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.539592 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.539698 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.539914 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.540005 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.540237 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.540363 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.540562 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.540681 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.540886 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.540988 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.541221 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.541320 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.541536 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.541643 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.541846 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.541947 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.542178 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.542292 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.542416 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 09 02:39:43.542517 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:39:43.542707 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 09 02:39:43.697743 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO dbcounter [None req-a94e7d1c-b328-430d-8eec-cf71430bef38 None None] Registered counter for database nova_api Aug 09 02:39:43.697986 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO dbcounter [None req-e36ee3f9-5998-4ef2-b785-77e8ca563804 None None] Registered counter for database nova_api Aug 09 02:39:43.717900 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_db.sqlalchemy.engines [None req-e36ee3f9-5998-4ef2-b785-77e8ca563804 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124427) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 02:39:43.719713 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_db.sqlalchemy.engines [None req-a94e7d1c-b328-430d-8eec-cf71430bef38 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124425) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 02:39:43.725657 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writer thread running {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 02:39:43.726864 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writer thread running {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 02:39:43.781284 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.context [None req-e36ee3f9-5998-4ef2-b785-77e8ca563804 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6567d965-9880-4701-afff-5a3d599c8537(cell1) {{(pid=124427) load_cells /opt/stack/nova/nova/context.py:464}} Aug 09 02:39:43.782267 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.context [None req-a94e7d1c-b328-430d-8eec-cf71430bef38 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6567d965-9880-4701-afff-5a3d599c8537(cell1) {{(pid=124425) load_cells /opt/stack/nova/nova/context.py:464}} Aug 09 02:39:43.785449 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e36ee3f9-5998-4ef2-b785-77e8ca563804 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:39:43.785863 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e36ee3f9-5998-4ef2-b785-77e8ca563804 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:39:43.786470 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a94e7d1c-b328-430d-8eec-cf71430bef38 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:39:43.786948 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a94e7d1c-b328-430d-8eec-cf71430bef38 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:39:43.787504 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e36ee3f9-5998-4ef2-b785-77e8ca563804 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:39:43.788225 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e36ee3f9-5998-4ef2-b785-77e8ca563804 None None] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:39:43.788564 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a94e7d1c-b328-430d-8eec-cf71430bef38 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:39:43.788673 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e36ee3f9-5998-4ef2-b785-77e8ca563804 None None] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:39:43.789294 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a94e7d1c-b328-430d-8eec-cf71430bef38 None None] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:39:43.789742 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a94e7d1c-b328-430d-8eec-cf71430bef38 None None] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:39:43.790689 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e36ee3f9-5998-4ef2-b785-77e8ca563804 None None] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:39:43.791858 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a94e7d1c-b328-430d-8eec-cf71430bef38 None None] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:39:43.792695 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO dbcounter [None req-e36ee3f9-5998-4ef2-b785-77e8ca563804 None None] Registered counter for database nova_cell0 Aug 09 02:39:43.793880 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO dbcounter [None req-a94e7d1c-b328-430d-8eec-cf71430bef38 None None] Registered counter for database nova_cell0 Aug 09 02:39:43.796748 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO dbcounter [None req-e36ee3f9-5998-4ef2-b785-77e8ca563804 None None] Registered counter for database nova_cell1 Aug 09 02:39:43.797903 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO dbcounter [None req-a94e7d1c-b328-430d-8eec-cf71430bef38 None None] Registered counter for database nova_cell1 Aug 09 02:39:43.804441 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_db.sqlalchemy.engines [None req-e36ee3f9-5998-4ef2-b785-77e8ca563804 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124427) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 02:39:43.805819 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_db.sqlalchemy.engines [None req-e36ee3f9-5998-4ef2-b785-77e8ca563804 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124427) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 02:39:43.807691 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_db.sqlalchemy.engines [None req-a94e7d1c-b328-430d-8eec-cf71430bef38 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124425) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 02:39:43.810048 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_db.sqlalchemy.engines [None req-a94e7d1c-b328-430d-8eec-cf71430bef38 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124425) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 02:39:43.812830 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writer thread running {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 02:39:43.814187 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writer thread running {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 02:39:43.815336 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writer thread running {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 02:39:43.817770 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writer thread running {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 02:39:43.958622 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO dbcounter [None req-e36ee3f9-5998-4ef2-b785-77e8ca563804 None None] Registered counter for database nova_cell0 Aug 09 02:39:43.959030 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO dbcounter [None req-a94e7d1c-b328-430d-8eec-cf71430bef38 None None] Registered counter for database nova_cell0 Aug 09 02:39:43.967720 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_db.sqlalchemy.engines [None req-a94e7d1c-b328-430d-8eec-cf71430bef38 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124425) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 02:39:43.969526 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_db.sqlalchemy.engines [None req-e36ee3f9-5998-4ef2-b785-77e8ca563804 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124427) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 02:39:43.972395 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writer thread running {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 02:39:43.975387 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writer thread running {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 02:39:44.284848 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: WARNING keystonemiddleware.auth_token [None req-e36ee3f9-5998-4ef2-b785-77e8ca563804 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 02:39:44.287527 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: WARNING keystonemiddleware.auth_token [None req-a94e7d1c-b328-430d-8eec-cf71430bef38 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 02:39:44.292154 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: WARNING keystonemiddleware.auth_token [None req-e36ee3f9-5998-4ef2-b785-77e8ca563804 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 02:39:44.295324 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: WARNING keystonemiddleware.auth_token [None req-a94e7d1c-b328-430d-8eec-cf71430bef38 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 02:39:44.647874 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: WARNING keystonemiddleware.auth_token [None req-e36ee3f9-5998-4ef2-b785-77e8ca563804 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 02:39:44.653946 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: WARNING keystonemiddleware.auth_token [None req-e36ee3f9-5998-4ef2-b785-77e8ca563804 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 02:39:44.655736 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: WARNING keystonemiddleware.auth_token [None req-a94e7d1c-b328-430d-8eec-cf71430bef38 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 02:39:44.660314 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55bbb9ed59c0 pid: 124427 (default app) Aug 09 02:39:44.661770 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: WARNING keystonemiddleware.auth_token [None req-a94e7d1c-b328-430d-8eec-cf71430bef38 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 02:39:44.668097 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55bbb9ed59c0 pid: 124425 (default app) Aug 09 02:40:22.835624 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_api:SELECT=3 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:40:22.836536 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_cell1:SELECT=3 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:40:22.837326 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_cell0:SELECT=3 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:40:22.838101 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_cell0:SELECT=3 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:40:23.328532 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-e17c1759-fc5c-4266-acd4-f69891678bbb tempest-VolumesTestJSON-2012485958 tempest-VolumesTestJSON-2012485958-project] Calling method '.version_select at 0x7fb0a24baa60>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:40:24.378828 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-e17c1759-fc5c-4266-acd4-f69891678bbb tempest-VolumesTestJSON-2012485958 tempest-VolumesTestJSON-2012485958-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/7563f270-1da4-4b70-964a-9cf6ba50881f" status: 200 len: 350 microversion: 2.1 time: 1.555143 Aug 09 02:40:24.383307 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 1/1] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Aug 9 02:40:22 2022] GET /compute/v2.1/os-volumes/7563f270-1da4-4b70-964a-9cf6ba50881f => generated 350 bytes in 1565 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:40:26.261473 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_api:SELECT=3 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:40:26.262497 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_cell1:SELECT=3 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:40:26.264114 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_cell0:SELECT=3 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:40:26.267427 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_cell0:SELECT=3 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:40:26.393265 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-6952f7d0-689e-4699-a147-6a4b2b9fb104 tempest-VolumesTestJSON-2012485958 tempest-VolumesTestJSON-2012485958-project] Calling method '.version_select at 0x7fb0a22ffc10>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:40:26.478593 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-6952f7d0-689e-4699-a147-6a4b2b9fb104 tempest-VolumesTestJSON-2012485958 tempest-VolumesTestJSON-2012485958-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/a57ac6c3-b779-43e2-88bd-20a086798634" status: 200 len: 351 microversion: 2.1 time: 0.090135 Aug 09 02:40:26.479495 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 2/2] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Aug 9 02:40:26 2022] GET /compute/v2.1/os-volumes/a57ac6c3-b779-43e2-88bd-20a086798634 => generated 351 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:40:27.361451 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-a5ee6b3a-dc08-4fe9-af2c-2842be176ee5 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-92196913", "imageRef": "04a06944-b2a8-4a65-b2a6-7ed3ff18a627", "flavorRef": "452", "networks": [{"uuid": "b3049e7c-6008-434c-a53c-a1a2f6df9e45"}]}} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:40:28.183692 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.network.neutron [None req-a5ee6b3a-dc08-4fe9-af2c-2842be176ee5 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] validate_networks() for [('b3049e7c-6008-434c-a53c-a1a2f6df9e45', None, None, None, None, None)] {{(pid=124425) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 02:40:28.259867 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-281f367f-5c54-4a4b-920c-245bbbc0838f tempest-VolumesTestJSON-2012485958 tempest-VolumesTestJSON-2012485958-project] Calling method '.version_select at 0x7fb0a22c23a0>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:40:28.390046 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-281f367f-5c54-4a4b-920c-245bbbc0838f tempest-VolumesTestJSON-2012485958 tempest-VolumesTestJSON-2012485958-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/9a1d1fab-e475-4e6d-a9ec-3d0e518ea6f0" status: 200 len: 351 microversion: 2.1 time: 0.135781 Aug 09 02:40:28.390704 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 3/3] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Aug 9 02:40:28 2022] GET /compute/v2.1/os-volumes/9a1d1fab-e475-4e6d-a9ec-3d0e518ea6f0 => generated 351 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:40:28.419816 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-7e7edf6b-89dc-4c3c-9946-4b5509a84611 tempest-VolumesTestJSON-2012485958 tempest-VolumesTestJSON-2012485958-project] Calling method '.version_select at 0x7fb0a22c2940>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:40:28.592901 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-7e7edf6b-89dc-4c3c-9946-4b5509a84611 tempest-VolumesTestJSON-2012485958 tempest-VolumesTestJSON-2012485958-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.189873 Aug 09 02:40:28.593467 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 4/4] 10.222.0.20 () {58 vars in 1134 bytes} [Tue Aug 9 02:40:28 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:40:28.610007 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-7864f859-74f3-4057-81ed-81378cf968e4 tempest-VolumesTestJSON-2012485958 tempest-VolumesTestJSON-2012485958-project] Calling method '.version_select at 0x7fb0a22c2430>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:40:28.728299 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-7864f859-74f3-4057-81ed-81378cf968e4 tempest-VolumesTestJSON-2012485958 tempest-VolumesTestJSON-2012485958-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.121518 Aug 09 02:40:28.739894 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 5/5] 10.222.0.20 () {58 vars in 1149 bytes} [Tue Aug 9 02:40:28 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:40:28.745799 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-ec8a40fe-8950-434f-800c-d2811c559561 tempest-VolumesTestJSON-2012485958 tempest-VolumesTestJSON-2012485958-project] Calling method '.version_select at 0x7fb0a22c21f0>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:40:28.846741 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-ec8a40fe-8950-434f-800c-d2811c559561 tempest-VolumesTestJSON-2012485958 tempest-VolumesTestJSON-2012485958-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.105337 Aug 09 02:40:28.847955 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 6/6] 10.222.0.20 () {58 vars in 1134 bytes} [Tue Aug 9 02:40:28 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:40:28.862595 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-d9684aea-53f4-436c-8c10-86e11d9a8069 tempest-VolumesTestJSON-2012485958 tempest-VolumesTestJSON-2012485958-project] Calling method '.version_select at 0x7fb0a22d79d0>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:40:28.987304 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-d9684aea-53f4-436c-8c10-86e11d9a8069 tempest-VolumesTestJSON-2012485958 tempest-VolumesTestJSON-2012485958-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.129582 Aug 09 02:40:28.991913 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 7/7] 10.222.0.20 () {58 vars in 1167 bytes} [Tue Aug 9 02:40:28 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:40:29.008066 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-dbe377a8-076a-4620-82b3-d3b76d876dfd tempest-VolumesTestJSON-2012485958 tempest-VolumesTestJSON-2012485958-project] Calling method '.version_select at 0x7fb0a22d9c10>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:40:29.226695 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-dbe377a8-076a-4620-82b3-d3b76d876dfd tempest-VolumesTestJSON-2012485958 tempest-VolumesTestJSON-2012485958-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.222455 Aug 09 02:40:29.238514 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 8/8] 10.222.0.20 () {58 vars in 1170 bytes} [Tue Aug 9 02:40:29 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:40:29.244066 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-2fb4dfbf-9c90-46bf-afc7-a07fc72bab9b tempest-VolumesTestJSON-2012485958 tempest-VolumesTestJSON-2012485958-project] Calling method '.version_select at 0x7fb0a2c4d0d0>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:40:29.432374 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-2fb4dfbf-9c90-46bf-afc7-a07fc72bab9b tempest-VolumesTestJSON-2012485958 tempest-VolumesTestJSON-2012485958-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.192533 Aug 09 02:40:29.441580 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 9/9] 10.222.0.20 () {58 vars in 1155 bytes} [Tue Aug 9 02:40:29 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:40:29.450860 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-288befdb-2041-4c75-963b-9b14a8f84487 tempest-VolumesTestJSON-2012485958 tempest-VolumesTestJSON-2012485958-project] Calling method '.version_select at 0x7fb0a22d9820>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:40:29.644665 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-288befdb-2041-4c75-963b-9b14a8f84487 tempest-VolumesTestJSON-2012485958 tempest-VolumesTestJSON-2012485958-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.201871 Aug 09 02:40:29.645384 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 10/10] 10.222.0.20 () {58 vars in 1188 bytes} [Tue Aug 9 02:40:29 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:40:29.661365 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-50eecc52-9185-46ef-905c-c8dcf20e0cf4 tempest-VolumesTestJSON-2012485958 tempest-VolumesTestJSON-2012485958-project] Calling method '.version_select at 0x7fb0a22e0af0>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:40:29.854470 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-50eecc52-9185-46ef-905c-c8dcf20e0cf4 tempest-VolumesTestJSON-2012485958 tempest-VolumesTestJSON-2012485958-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.198768 Aug 09 02:40:29.859480 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 11/11] 10.222.0.20 () {58 vars in 1155 bytes} [Tue Aug 9 02:40:29 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:40:30.059980 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.virt.hardware [None req-a5ee6b3a-dc08-4fe9-af2c-2842be176ee5 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Flavor limits 0:0:0 {{(pid=124425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 02:40:30.061452 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.virt.hardware [None req-a5ee6b3a-dc08-4fe9-af2c-2842be176ee5 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Image limits 0:0:0 {{(pid=124425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 02:40:30.062271 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.virt.hardware [None req-a5ee6b3a-dc08-4fe9-af2c-2842be176ee5 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Flavor pref 0:0:0 {{(pid=124425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 02:40:30.062875 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.virt.hardware [None req-a5ee6b3a-dc08-4fe9-af2c-2842be176ee5 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Image pref 0:0:0 {{(pid=124425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 02:40:30.064442 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.virt.hardware [None req-a5ee6b3a-dc08-4fe9-af2c-2842be176ee5 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 02:40:30.100057 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a5ee6b3a-dc08-4fe9-af2c-2842be176ee5 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:40:30.100870 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a5ee6b3a-dc08-4fe9-af2c-2842be176ee5 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:40:30.101505 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a5ee6b3a-dc08-4fe9-af2c-2842be176ee5 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:40:30.102482 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a5ee6b3a-dc08-4fe9-af2c-2842be176ee5 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:40:30.103498 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a5ee6b3a-dc08-4fe9-af2c-2842be176ee5 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:40:30.104113 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a5ee6b3a-dc08-4fe9-af2c-2842be176ee5 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:40:30.178196 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.quota [None req-a5ee6b3a-dc08-4fe9-af2c-2842be176ee5 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Getting quotas for project 88f96c9ae9b44b91a4db2187160a5688. Resources: {'cores', 'ram', 'instances'} {{(pid=124425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 02:40:30.188575 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.quota [None req-a5ee6b3a-dc08-4fe9-af2c-2842be176ee5 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Getting quotas for user 113d48eb42524e62bfc95606f93f3736 and project 88f96c9ae9b44b91a4db2187160a5688. Resources: {'cores', 'ram', 'instances'} {{(pid=124425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 02:40:30.202979 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-a5ee6b3a-dc08-4fe9-af2c-2842be176ee5 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Going to run 1 instances... {{(pid=124425) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 02:40:30.206751 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-a5ee6b3a-dc08-4fe9-af2c-2842be176ee5 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] [instance: 1e614721-c888-4eaf-b834-42497e80345c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='04a06944-b2a8-4a65-b2a6-7ed3ff18a627',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 02:40:30.383968 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-a5ee6b3a-dc08-4fe9-af2c-2842be176ee5 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.127651 Aug 09 02:40:30.393246 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 1/12] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Aug 9 02:40:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 4138 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 02:40:30.400588 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-dfd2e3aa-a183-4ca0-9018-e2b990981d82 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:40:30.401610 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-dfd2e3aa-a183-4ca0-9018-e2b990981d82 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] [instance: 1e614721-c888-4eaf-b834-42497e80345c] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:40:30.888510 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-dfd2e3aa-a183-4ca0-9018-e2b990981d82 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113d48eb42524e62bfc95606f93f3736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f96c9ae9b44b91a4db2187160a5688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:40:30.909362 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-dfd2e3aa-a183-4ca0-9018-e2b990981d82 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] 10.222.0.20 "GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c" status: 200 len: 1213 microversion: 2.1 time: 0.512948 Aug 09 02:40:30.926599 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 12/13] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:40:30 2022] GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c => generated 1213 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:40:31.940018 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-26e2f2c1-4128-482a-be5d-deb02eda2ce8 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:40:31.941043 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-26e2f2c1-4128-482a-be5d-deb02eda2ce8 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] [instance: 1e614721-c888-4eaf-b834-42497e80345c] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:40:32.186188 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-26e2f2c1-4128-482a-be5d-deb02eda2ce8 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113d48eb42524e62bfc95606f93f3736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f96c9ae9b44b91a4db2187160a5688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:40:32.243297 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-26e2f2c1-4128-482a-be5d-deb02eda2ce8 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] 10.222.0.20 "GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c" status: 200 len: 1213 microversion: 2.1 time: 0.303480 Aug 09 02:40:32.249358 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 2/14] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:40:31 2022] GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c => generated 1213 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:40:33.271046 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-2499eb59-f5b8-45a3-a73d-ab1e88b2befd tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:40:33.272393 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-2499eb59-f5b8-45a3-a73d-ab1e88b2befd tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] [instance: 1e614721-c888-4eaf-b834-42497e80345c] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:40:33.290958 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2499eb59-f5b8-45a3-a73d-ab1e88b2befd tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:40:33.294342 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2499eb59-f5b8-45a3-a73d-ab1e88b2befd tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:40:33.296626 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2499eb59-f5b8-45a3-a73d-ab1e88b2befd tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:40:33.298882 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2499eb59-f5b8-45a3-a73d-ab1e88b2befd tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:40:33.303088 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2499eb59-f5b8-45a3-a73d-ab1e88b2befd tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:40:33.308447 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2499eb59-f5b8-45a3-a73d-ab1e88b2befd tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:40:33.698185 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-2499eb59-f5b8-45a3-a73d-ab1e88b2befd tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113d48eb42524e62bfc95606f93f3736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f96c9ae9b44b91a4db2187160a5688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:40:33.722898 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-2499eb59-f5b8-45a3-a73d-ab1e88b2befd tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] 10.222.0.20 "GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c" status: 200 len: 1209 microversion: 2.1 time: 0.461823 Aug 09 02:40:33.740901 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 13/15] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:40:33 2022] GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c => generated 1209 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:40:34.752235 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-9f650ded-7c95-4982-b874-ce53f9636839 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:40:34.752858 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-9f650ded-7c95-4982-b874-ce53f9636839 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] [instance: 1e614721-c888-4eaf-b834-42497e80345c] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:40:34.771977 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9f650ded-7c95-4982-b874-ce53f9636839 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:40:34.772493 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9f650ded-7c95-4982-b874-ce53f9636839 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:40:34.775107 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9f650ded-7c95-4982-b874-ce53f9636839 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:40:34.777143 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9f650ded-7c95-4982-b874-ce53f9636839 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:40:34.777627 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9f650ded-7c95-4982-b874-ce53f9636839 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:40:34.781883 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9f650ded-7c95-4982-b874-ce53f9636839 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:40:35.324256 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-9f650ded-7c95-4982-b874-ce53f9636839 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113d48eb42524e62bfc95606f93f3736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f96c9ae9b44b91a4db2187160a5688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:40:35.352836 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-9f650ded-7c95-4982-b874-ce53f9636839 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] 10.222.0.20 "GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c" status: 200 len: 1271 microversion: 2.1 time: 0.603380 Aug 09 02:40:35.354496 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 3/16] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:40:34 2022] GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c => generated 1271 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:40:36.378299 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-54af4173-dd23-47cb-b947-4e3eb25a17d8 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:40:36.379988 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-54af4173-dd23-47cb-b947-4e3eb25a17d8 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] [instance: 1e614721-c888-4eaf-b834-42497e80345c] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:40:36.397633 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-54af4173-dd23-47cb-b947-4e3eb25a17d8 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:40:36.398138 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-54af4173-dd23-47cb-b947-4e3eb25a17d8 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:40:36.411661 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-54af4173-dd23-47cb-b947-4e3eb25a17d8 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:40:36.413448 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-54af4173-dd23-47cb-b947-4e3eb25a17d8 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:40:36.429412 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-54af4173-dd23-47cb-b947-4e3eb25a17d8 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:40:36.440141 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-54af4173-dd23-47cb-b947-4e3eb25a17d8 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:40:36.594286 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-4060ff6b-dcfe-4f0b-83d4-67f84754c8ff tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Action: 'create', calling method: .version_select at 0x7fb0a220cf70>, body: {"keypair": {"name": "tempest-keypair-694358221", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGlMZlIMJYDoqKLiOPqHiWuLWG5nQStRc8QOW1wTWbL0AtQG/zHPSXfgDLWV5ku1qaZzdJWExL/+x8fCN+6uIL+jUuQyqefy1ZjB+KIgS7zhFdE4qR2YtI/RnxNL66mshA=="}} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:40:36.673858 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-54af4173-dd23-47cb-b947-4e3eb25a17d8 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113d48eb42524e62bfc95606f93f3736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f96c9ae9b44b91a4db2187160a5688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:40:36.683647 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-54af4173-dd23-47cb-b947-4e3eb25a17d8 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] 10.222.0.20 "GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c" status: 200 len: 1271 microversion: 2.1 time: 0.309686 Aug 09 02:40:36.692671 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 4/17] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:40:36 2022] GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c => generated 1271 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:40:36.914488 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.quota [None req-4060ff6b-dcfe-4f0b-83d4-67f84754c8ff tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Getting quotas for project 8ce26c854fc24cadb2be5ebd441b8f3a. Resources: {'key_pairs'} {{(pid=124427) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 02:40:36.961670 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.quota [None req-4060ff6b-dcfe-4f0b-83d4-67f84754c8ff tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Getting quotas for user 43232b9b191047f9a3e6ebab7ad36f02 and project 8ce26c854fc24cadb2be5ebd441b8f3a. Resources: {'key_pairs'} {{(pid=124427) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 02:40:37.249052 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-4060ff6b-dcfe-4f0b-83d4-67f84754c8ff tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.395118 Aug 09 02:40:37.250024 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 14/18] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Aug 9 02:40:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:40:37.711436 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-e212e2a4-8120-4bb3-8770-89765e3b0871 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:40:37.712088 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-e212e2a4-8120-4bb3-8770-89765e3b0871 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] [instance: 1e614721-c888-4eaf-b834-42497e80345c] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:40:37.735494 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e212e2a4-8120-4bb3-8770-89765e3b0871 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:40:37.736194 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e212e2a4-8120-4bb3-8770-89765e3b0871 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:40:37.736656 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e212e2a4-8120-4bb3-8770-89765e3b0871 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:40:37.737393 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e212e2a4-8120-4bb3-8770-89765e3b0871 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:40:37.746472 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e212e2a4-8120-4bb3-8770-89765e3b0871 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:40:37.748791 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e212e2a4-8120-4bb3-8770-89765e3b0871 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:40:38.102318 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-e212e2a4-8120-4bb3-8770-89765e3b0871 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113d48eb42524e62bfc95606f93f3736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f96c9ae9b44b91a4db2187160a5688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:40:38.134633 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-e212e2a4-8120-4bb3-8770-89765e3b0871 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] 10.222.0.20 "GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c" status: 200 len: 1271 microversion: 2.1 time: 0.429135 Aug 09 02:40:38.154166 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 5/19] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:40:37 2022] GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c => generated 1271 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:40:39.178872 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-b4d958e1-8f54-4265-8a2b-50d94448025c tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:40:39.180306 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-b4d958e1-8f54-4265-8a2b-50d94448025c tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] [instance: 1e614721-c888-4eaf-b834-42497e80345c] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:40:39.200030 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b4d958e1-8f54-4265-8a2b-50d94448025c tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:40:39.201417 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b4d958e1-8f54-4265-8a2b-50d94448025c tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:40:39.202889 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b4d958e1-8f54-4265-8a2b-50d94448025c tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:40:39.205652 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b4d958e1-8f54-4265-8a2b-50d94448025c tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:40:39.209846 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b4d958e1-8f54-4265-8a2b-50d94448025c tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:40:39.210993 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b4d958e1-8f54-4265-8a2b-50d94448025c tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:40:40.001710 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-b4d958e1-8f54-4265-8a2b-50d94448025c tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113d48eb42524e62bfc95606f93f3736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f96c9ae9b44b91a4db2187160a5688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:40:40.013502 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-b4d958e1-8f54-4265-8a2b-50d94448025c tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] 10.222.0.20 "GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c" status: 200 len: 1271 microversion: 2.1 time: 0.846790 Aug 09 02:40:40.018481 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 15/20] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:40:39 2022] GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c => generated 1271 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:40:41.039949 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-6609251b-38db-43a1-b3fa-2ea4869e5592 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:40:41.041207 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-6609251b-38db-43a1-b3fa-2ea4869e5592 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] [instance: 1e614721-c888-4eaf-b834-42497e80345c] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:40:41.052316 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_cell0:SELECT=2 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:40:41.055554 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6609251b-38db-43a1-b3fa-2ea4869e5592 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:40:41.058529 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6609251b-38db-43a1-b3fa-2ea4869e5592 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:40:41.060278 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6609251b-38db-43a1-b3fa-2ea4869e5592 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:40:41.076769 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6609251b-38db-43a1-b3fa-2ea4869e5592 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:40:41.077677 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6609251b-38db-43a1-b3fa-2ea4869e5592 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:40:41.079844 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6609251b-38db-43a1-b3fa-2ea4869e5592 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:40:42.216072 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_cell0:SELECT=8 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:40:42.458213 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-6609251b-38db-43a1-b3fa-2ea4869e5592 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113d48eb42524e62bfc95606f93f3736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f96c9ae9b44b91a4db2187160a5688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:40:42.478916 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-6609251b-38db-43a1-b3fa-2ea4869e5592 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] 10.222.0.20 "GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c" status: 200 len: 1313 microversion: 2.1 time: 1.443906 Aug 09 02:40:42.480897 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 6/21] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:40:41 2022] GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c => generated 1313 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:40:42.680154 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-9c11245b-b440-49f5-90dd-6cca09d725a1 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2091699548", "imageRef": "04a06944-b2a8-4a65-b2a6-7ed3ff18a627", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6bf516e7-9ea4-4f2e-9b3b-a70a745206d7"}], "security_groups": [{"name": "tempest-securitygroup--2107541683"}], "key_name": "tempest-keypair-694358221", "user_data": "}} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:40:43.121096 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.network.neutron [None req-9c11245b-b440-49f5-90dd-6cca09d725a1 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] validate_networks() for [('6bf516e7-9ea4-4f2e-9b3b-a70a745206d7', None, None, None, None, None)] {{(pid=124427) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 02:40:43.502671 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-6e135e86-f279-4b69-98b6-3bd984964cf0 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:40:43.504278 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-6e135e86-f279-4b69-98b6-3bd984964cf0 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] [instance: 1e614721-c888-4eaf-b834-42497e80345c] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:40:43.515451 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6e135e86-f279-4b69-98b6-3bd984964cf0 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:40:43.517543 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6e135e86-f279-4b69-98b6-3bd984964cf0 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:40:43.520174 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6e135e86-f279-4b69-98b6-3bd984964cf0 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:40:43.521274 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6e135e86-f279-4b69-98b6-3bd984964cf0 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:40:43.523683 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6e135e86-f279-4b69-98b6-3bd984964cf0 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:40:43.525027 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6e135e86-f279-4b69-98b6-3bd984964cf0 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:40:44.323684 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-6e135e86-f279-4b69-98b6-3bd984964cf0 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113d48eb42524e62bfc95606f93f3736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f96c9ae9b44b91a4db2187160a5688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:40:44.346222 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-6e135e86-f279-4b69-98b6-3bd984964cf0 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] 10.222.0.20 "GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c" status: 200 len: 1313 microversion: 2.1 time: 0.848713 Aug 09 02:40:44.347785 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 7/22] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:40:43 2022] GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c => generated 1313 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:40:45.368900 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-db45617a-aa6c-4aea-bda4-c4e04050437d tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:40:45.369545 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-db45617a-aa6c-4aea-bda4-c4e04050437d tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] [instance: 1e614721-c888-4eaf-b834-42497e80345c] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:40:45.383144 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-db45617a-aa6c-4aea-bda4-c4e04050437d tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:40:45.383667 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-db45617a-aa6c-4aea-bda4-c4e04050437d tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:40:45.390780 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-db45617a-aa6c-4aea-bda4-c4e04050437d tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:40:45.402662 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-db45617a-aa6c-4aea-bda4-c4e04050437d tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:40:45.410875 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-db45617a-aa6c-4aea-bda4-c4e04050437d tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:40:45.411615 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-db45617a-aa6c-4aea-bda4-c4e04050437d tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:40:45.761458 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.virt.hardware [None req-9c11245b-b440-49f5-90dd-6cca09d725a1 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Flavor limits 0:0:0 {{(pid=124427) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 02:40:45.762175 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.virt.hardware [None req-9c11245b-b440-49f5-90dd-6cca09d725a1 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Image limits 0:0:0 {{(pid=124427) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 02:40:45.762773 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.virt.hardware [None req-9c11245b-b440-49f5-90dd-6cca09d725a1 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Flavor pref 0:0:0 {{(pid=124427) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 02:40:45.763275 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.virt.hardware [None req-9c11245b-b440-49f5-90dd-6cca09d725a1 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Image pref 0:0:0 {{(pid=124427) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 02:40:45.763801 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.virt.hardware [None req-9c11245b-b440-49f5-90dd-6cca09d725a1 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124427) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 02:40:45.789698 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9c11245b-b440-49f5-90dd-6cca09d725a1 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:40:45.792777 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9c11245b-b440-49f5-90dd-6cca09d725a1 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:40:45.793787 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9c11245b-b440-49f5-90dd-6cca09d725a1 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:40:45.799207 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9c11245b-b440-49f5-90dd-6cca09d725a1 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:40:45.802775 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9c11245b-b440-49f5-90dd-6cca09d725a1 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:40:45.805376 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9c11245b-b440-49f5-90dd-6cca09d725a1 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:40:45.924176 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.quota [None req-9c11245b-b440-49f5-90dd-6cca09d725a1 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Getting quotas for project 8ce26c854fc24cadb2be5ebd441b8f3a. Resources: {'cores', 'ram', 'instances'} {{(pid=124427) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 02:40:45.945704 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.quota [None req-9c11245b-b440-49f5-90dd-6cca09d725a1 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Getting quotas for user 43232b9b191047f9a3e6ebab7ad36f02 and project 8ce26c854fc24cadb2be5ebd441b8f3a. Resources: {'cores', 'ram', 'instances'} {{(pid=124427) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 02:40:45.998605 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-9c11245b-b440-49f5-90dd-6cca09d725a1 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Going to run 1 instances... {{(pid=124427) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 02:40:46.006815 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-9c11245b-b440-49f5-90dd-6cca09d725a1 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='04a06944-b2a8-4a65-b2a6-7ed3ff18a627',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124427) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 02:40:46.064946 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-db45617a-aa6c-4aea-bda4-c4e04050437d tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113d48eb42524e62bfc95606f93f3736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f96c9ae9b44b91a4db2187160a5688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:40:46.087729 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-db45617a-aa6c-4aea-bda4-c4e04050437d tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] 10.222.0.20 "GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c" status: 200 len: 1313 microversion: 2.1 time: 0.722481 Aug 09 02:40:46.098491 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 8/23] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:40:45 2022] GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c => generated 1313 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:40:46.252237 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-9c11245b-b440-49f5-90dd-6cca09d725a1 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.580579 Aug 09 02:40:46.253352 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 16/24] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Aug 9 02:40:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 3582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 02:40:46.264297 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-7b2b50f7-f261-43c5-bbe1-b77bc1bc6269 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:40:46.264913 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-7b2b50f7-f261-43c5-bbe1-b77bc1bc6269 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:40:46.382128 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-7b2b50f7-f261-43c5-bbe1-b77bc1bc6269 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:40:46.401303 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-7b2b50f7-f261-43c5-bbe1-b77bc1bc6269 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a" status: 200 len: 1241 microversion: 2.1 time: 0.136178 Aug 09 02:40:46.414549 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 9/25] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:40:46 2022] GET /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a => generated 1241 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:40:47.111266 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-1711ae28-1875-41a1-aeed-4203854f01ec tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:40:47.112947 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-1711ae28-1875-41a1-aeed-4203854f01ec tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] [instance: 1e614721-c888-4eaf-b834-42497e80345c] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:40:47.144973 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1711ae28-1875-41a1-aeed-4203854f01ec tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:40:47.147458 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1711ae28-1875-41a1-aeed-4203854f01ec tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:40:47.148024 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1711ae28-1875-41a1-aeed-4203854f01ec tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:40:47.148880 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1711ae28-1875-41a1-aeed-4203854f01ec tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:40:47.151591 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1711ae28-1875-41a1-aeed-4203854f01ec tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:40:47.152314 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1711ae28-1875-41a1-aeed-4203854f01ec tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:40:47.423942 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-ceee1913-d2b0-4509-bedd-4495cde515db tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:40:47.424753 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-ceee1913-d2b0-4509-bedd-4495cde515db tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:40:47.608480 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-ceee1913-d2b0-4509-bedd-4495cde515db tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:40:47.622436 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-ceee1913-d2b0-4509-bedd-4495cde515db tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a" status: 200 len: 1241 microversion: 2.1 time: 0.202571 Aug 09 02:40:47.639844 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 10/26] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:40:47 2022] GET /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a => generated 1241 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:40:47.876662 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-1711ae28-1875-41a1-aeed-4203854f01ec tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113d48eb42524e62bfc95606f93f3736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f96c9ae9b44b91a4db2187160a5688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:40:47.887255 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-1711ae28-1875-41a1-aeed-4203854f01ec tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] 10.222.0.20 "GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c" status: 200 len: 1313 microversion: 2.1 time: 0.780524 Aug 09 02:40:47.902507 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 17/27] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:40:47 2022] GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c => generated 1313 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:40:48.661569 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-3145cc40-d558-4973-82f1-1f6156b5e89e tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:40:48.662790 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-3145cc40-d558-4973-82f1-1f6156b5e89e tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:40:48.679162 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3145cc40-d558-4973-82f1-1f6156b5e89e tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:40:48.681991 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3145cc40-d558-4973-82f1-1f6156b5e89e tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:40:48.685424 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3145cc40-d558-4973-82f1-1f6156b5e89e tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:40:48.688213 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3145cc40-d558-4973-82f1-1f6156b5e89e tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:40:48.692138 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3145cc40-d558-4973-82f1-1f6156b5e89e tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:40:48.694842 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3145cc40-d558-4973-82f1-1f6156b5e89e tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:40:48.908209 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-222c90df-2bb3-454a-870b-ad65d38e99dd tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:40:48.908896 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-222c90df-2bb3-454a-870b-ad65d38e99dd tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] [instance: 1e614721-c888-4eaf-b834-42497e80345c] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:40:48.940275 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-222c90df-2bb3-454a-870b-ad65d38e99dd tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:40:48.940438 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-3145cc40-d558-4973-82f1-1f6156b5e89e tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:40:48.941806 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-222c90df-2bb3-454a-870b-ad65d38e99dd tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:40:48.942271 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-222c90df-2bb3-454a-870b-ad65d38e99dd tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:40:48.942986 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-222c90df-2bb3-454a-870b-ad65d38e99dd tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:40:48.943438 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-222c90df-2bb3-454a-870b-ad65d38e99dd tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:40:48.943856 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-222c90df-2bb3-454a-870b-ad65d38e99dd tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:40:48.950202 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-3145cc40-d558-4973-82f1-1f6156b5e89e tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a" status: 200 len: 1245 microversion: 2.1 time: 0.293890 Aug 09 02:40:48.953627 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 11/28] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:40:48 2022] GET /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a => generated 1245 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:40:49.411028 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-222c90df-2bb3-454a-870b-ad65d38e99dd tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113d48eb42524e62bfc95606f93f3736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f96c9ae9b44b91a4db2187160a5688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:40:49.426940 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-222c90df-2bb3-454a-870b-ad65d38e99dd tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] 10.222.0.20 "GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c" status: 200 len: 1313 microversion: 2.1 time: 0.517347 Aug 09 02:40:49.440301 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 18/29] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:40:48 2022] GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c => generated 1313 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:40:49.979882 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-27951534-d61f-4c93-aa4a-902f7f20b400 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:40:49.981380 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-27951534-d61f-4c93-aa4a-902f7f20b400 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:40:49.997295 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-27951534-d61f-4c93-aa4a-902f7f20b400 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:40:50.004705 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-27951534-d61f-4c93-aa4a-902f7f20b400 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:40:50.005284 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-27951534-d61f-4c93-aa4a-902f7f20b400 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:40:50.009145 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-27951534-d61f-4c93-aa4a-902f7f20b400 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:40:50.009738 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-27951534-d61f-4c93-aa4a-902f7f20b400 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:40:50.010199 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-27951534-d61f-4c93-aa4a-902f7f20b400 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:40:50.106894 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [req-d708ffbb-dd6f-4c28-a17d-a66d227c20f3 req-2a9033bf-d868-4477-86fc-33b0a34de10a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e614721-c888-4eaf-b834-42497e80345c", "tag": "d01cee1a-247a-4147-8cbe-c15281979780"}]} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:40:50.142013 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-d708ffbb-dd6f-4c28-a17d-a66d227c20f3 req-2a9033bf-d868-4477-86fc-33b0a34de10a service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:40:50.142912 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-d708ffbb-dd6f-4c28-a17d-a66d227c20f3 req-2a9033bf-d868-4477-86fc-33b0a34de10a service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:40:50.143577 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-d708ffbb-dd6f-4c28-a17d-a66d227c20f3 req-2a9033bf-d868-4477-86fc-33b0a34de10a service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:40:50.201940 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.compute.server_external_events [req-d708ffbb-dd6f-4c28-a17d-a66d227c20f3 req-2a9033bf-d868-4477-86fc-33b0a34de10a service nova] Creating event network-changed:d01cee1a-247a-4147-8cbe-c15281979780 for instance 1e614721-c888-4eaf-b834-42497e80345c on hv-cinder-85246 Aug 09 02:40:50.204911 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-d708ffbb-dd6f-4c28-a17d-a66d227c20f3 req-2a9033bf-d868-4477-86fc-33b0a34de10a service nova] Acquiring lock "compute-rpcapi-router" {{(pid=124425) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 09 02:40:50.207488 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-d708ffbb-dd6f-4c28-a17d-a66d227c20f3 req-2a9033bf-d868-4477-86fc-33b0a34de10a service nova] Acquired lock "compute-rpcapi-router" {{(pid=124425) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 09 02:40:50.209920 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-285cd691-13a1-4a5d-82db-28385bd0dd99 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:40:50.219535 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-285cd691-13a1-4a5d-82db-28385bd0dd99 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:40:50.220098 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-285cd691-13a1-4a5d-82db-28385bd0dd99 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:40:50.221079 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-285cd691-13a1-4a5d-82db-28385bd0dd99 None None] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:40:50.226113 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-285cd691-13a1-4a5d-82db-28385bd0dd99 None None] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:40:50.229127 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-285cd691-13a1-4a5d-82db-28385bd0dd99 None None] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:40:50.256451 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.compute.rpcapi [None req-285cd691-13a1-4a5d-82db-28385bd0dd99 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 09 02:40:50.263239 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-285cd691-13a1-4a5d-82db-28385bd0dd99 None None] Releasing lock "compute-rpcapi-router" {{(pid=124425) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 09 02:40:50.323987 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-285cd691-13a1-4a5d-82db-28385bd0dd99 None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.924446 Aug 09 02:40:50.329381 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 12/30] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:40:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:40:50.363709 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-27951534-d61f-4c93-aa4a-902f7f20b400 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:40:50.373134 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-27951534-d61f-4c93-aa4a-902f7f20b400 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a" status: 200 len: 1301 microversion: 2.1 time: 0.398462 Aug 09 02:40:50.381405 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 19/31] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:40:49 2022] GET /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a => generated 1301 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:40:50.452605 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-b8c846e7-a829-4efa-83cb-45b06f1eb508 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:40:50.453654 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-b8c846e7-a829-4efa-83cb-45b06f1eb508 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] [instance: 1e614721-c888-4eaf-b834-42497e80345c] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:40:50.499438 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b8c846e7-a829-4efa-83cb-45b06f1eb508 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:40:50.501368 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b8c846e7-a829-4efa-83cb-45b06f1eb508 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:40:50.504409 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b8c846e7-a829-4efa-83cb-45b06f1eb508 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:40:50.520143 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b8c846e7-a829-4efa-83cb-45b06f1eb508 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:40:50.525951 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b8c846e7-a829-4efa-83cb-45b06f1eb508 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:40:50.529273 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b8c846e7-a829-4efa-83cb-45b06f1eb508 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:40:50.906023 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-b8c846e7-a829-4efa-83cb-45b06f1eb508 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113d48eb42524e62bfc95606f93f3736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f96c9ae9b44b91a4db2187160a5688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:40:50.917649 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-b8c846e7-a829-4efa-83cb-45b06f1eb508 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] 10.222.0.20 "GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c" status: 200 len: 1313 microversion: 2.1 time: 0.470503 Aug 09 02:40:50.921793 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 13/32] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:40:50 2022] GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c => generated 1313 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:40:51.148525 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-0202244e-3dc0-4145-83cb-da193b0ed59c tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Action: 'create', calling method: .version_select at 0x7fb0a083d310>, body: {"keypair": {"name": "tempest-keypair-132344174", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOH2UP0pwjx4/9Ax3aWa1WXx1D8cTd7b/YFcEVhcpnypSDv+VJNGljqwc/MBol3gYqCTW7A5HZ1SuLKovh7u8/hm64TD9yPP5vqOBhvUkJcUgcw3sXjgj1ufEm1w++Iowg=="}} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:40:51.222712 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.quota [None req-0202244e-3dc0-4145-83cb-da193b0ed59c tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Getting quotas for project 467b42c2bec74fcbbf90d007a6e00096. Resources: {'key_pairs'} {{(pid=124427) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 02:40:51.252023 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.quota [None req-0202244e-3dc0-4145-83cb-da193b0ed59c tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Getting quotas for user 2aaa8a7f386e4ccc9ab5c356cdf1704f and project 467b42c2bec74fcbbf90d007a6e00096. Resources: {'key_pairs'} {{(pid=124427) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 02:40:51.339031 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-0202244e-3dc0-4145-83cb-da193b0ed59c tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.567323 Aug 09 02:40:51.344678 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 20/33] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Aug 9 02:40:50 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 02:40:51.402813 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-8a27149e-61df-4eb8-a5c7-eb7130fd3932 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:40:51.403494 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-8a27149e-61df-4eb8-a5c7-eb7130fd3932 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:40:51.419871 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8a27149e-61df-4eb8-a5c7-eb7130fd3932 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:40:51.421606 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8a27149e-61df-4eb8-a5c7-eb7130fd3932 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:40:51.431017 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8a27149e-61df-4eb8-a5c7-eb7130fd3932 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:40:51.432108 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8a27149e-61df-4eb8-a5c7-eb7130fd3932 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:40:51.435132 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8a27149e-61df-4eb8-a5c7-eb7130fd3932 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:40:51.436127 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8a27149e-61df-4eb8-a5c7-eb7130fd3932 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:40:51.685652 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-8a27149e-61df-4eb8-a5c7-eb7130fd3932 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:40:51.701713 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-8a27149e-61df-4eb8-a5c7-eb7130fd3932 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a" status: 200 len: 1299 microversion: 2.1 time: 0.303223 Aug 09 02:40:51.703911 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 14/34] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:40:51 2022] GET /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a => generated 1299 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:40:51.942730 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-23b0f971-a5b9-47af-bb58-1b2bcc22b66b tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:40:51.944060 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-23b0f971-a5b9-47af-bb58-1b2bcc22b66b tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] [instance: 1e614721-c888-4eaf-b834-42497e80345c] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:40:51.959563 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-23b0f971-a5b9-47af-bb58-1b2bcc22b66b tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:40:51.960426 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-23b0f971-a5b9-47af-bb58-1b2bcc22b66b tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:40:51.961884 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-23b0f971-a5b9-47af-bb58-1b2bcc22b66b tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:40:51.965923 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-23b0f971-a5b9-47af-bb58-1b2bcc22b66b tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:40:51.968321 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-23b0f971-a5b9-47af-bb58-1b2bcc22b66b tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:40:51.969159 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-23b0f971-a5b9-47af-bb58-1b2bcc22b66b tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:40:52.595375 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-23b0f971-a5b9-47af-bb58-1b2bcc22b66b tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113d48eb42524e62bfc95606f93f3736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f96c9ae9b44b91a4db2187160a5688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:40:52.612712 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-23b0f971-a5b9-47af-bb58-1b2bcc22b66b tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] 10.222.0.20 "GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c" status: 200 len: 1313 microversion: 2.1 time: 0.671637 Aug 09 02:40:52.616210 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 21/35] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:40:51 2022] GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c => generated 1313 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:40:52.727120 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-57aef06c-c247-4420-afda-160ae3938d59 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:40:52.727740 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-57aef06c-c247-4420-afda-160ae3938d59 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:40:52.739136 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-57aef06c-c247-4420-afda-160ae3938d59 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:40:52.739623 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-57aef06c-c247-4420-afda-160ae3938d59 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:40:52.741770 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-57aef06c-c247-4420-afda-160ae3938d59 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:40:52.742937 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-57aef06c-c247-4420-afda-160ae3938d59 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:40:52.745167 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-57aef06c-c247-4420-afda-160ae3938d59 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:40:52.746074 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-57aef06c-c247-4420-afda-160ae3938d59 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:40:53.026869 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-57aef06c-c247-4420-afda-160ae3938d59 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:40:53.046896 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-57aef06c-c247-4420-afda-160ae3938d59 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a" status: 200 len: 1299 microversion: 2.1 time: 0.323102 Aug 09 02:40:53.048332 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 22/36] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:40:52 2022] GET /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a => generated 1299 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:40:53.187391 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-476228dd-029b-4d89-b58e-a01f985ac311 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-231916351", "imageRef": "04a06944-b2a8-4a65-b2a6-7ed3ff18a627", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:40:53.294979 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.network.neutron [None req-476228dd-029b-4d89-b58e-a01f985ac311 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] validate_networks() for [('383daeb1-4f03-438c-8857-8e6c80656675', None, None, None, None, None)] {{(pid=124425) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 02:40:53.635996 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-b63ae327-a084-47d8-8604-d75635a5f5b5 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:40:53.636665 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-b63ae327-a084-47d8-8604-d75635a5f5b5 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] [instance: 1e614721-c888-4eaf-b834-42497e80345c] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:40:53.639717 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=5 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:40:53.649387 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b63ae327-a084-47d8-8604-d75635a5f5b5 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:40:53.649882 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b63ae327-a084-47d8-8604-d75635a5f5b5 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:40:53.650348 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b63ae327-a084-47d8-8604-d75635a5f5b5 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:40:53.651057 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b63ae327-a084-47d8-8604-d75635a5f5b5 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:40:53.651495 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b63ae327-a084-47d8-8604-d75635a5f5b5 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:40:53.651913 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b63ae327-a084-47d8-8604-d75635a5f5b5 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:40:53.658878 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_cell1:SELECT=45 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:40:54.463863 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-b63ae327-a084-47d8-8604-d75635a5f5b5 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113d48eb42524e62bfc95606f93f3736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f96c9ae9b44b91a4db2187160a5688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:40:54.475810 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-b63ae327-a084-47d8-8604-d75635a5f5b5 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] 10.222.0.20 "GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c" status: 200 len: 1313 microversion: 2.1 time: 0.840338 Aug 09 02:40:54.482589 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 23/37] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:40:53 2022] GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c => generated 1313 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:40:54.494324 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-ba74ed92-d0c0-4c9b-9c77-1eb763ce7940 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:40:54.495049 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-ba74ed92-d0c0-4c9b-9c77-1eb763ce7940 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:40:54.520653 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ba74ed92-d0c0-4c9b-9c77-1eb763ce7940 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:40:54.521201 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ba74ed92-d0c0-4c9b-9c77-1eb763ce7940 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:40:54.521785 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ba74ed92-d0c0-4c9b-9c77-1eb763ce7940 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:40:54.522609 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ba74ed92-d0c0-4c9b-9c77-1eb763ce7940 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:40:54.523097 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ba74ed92-d0c0-4c9b-9c77-1eb763ce7940 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:40:54.523506 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ba74ed92-d0c0-4c9b-9c77-1eb763ce7940 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:40:55.239936 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-ba74ed92-d0c0-4c9b-9c77-1eb763ce7940 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:40:55.257156 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-ba74ed92-d0c0-4c9b-9c77-1eb763ce7940 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a" status: 200 len: 1367 microversion: 2.1 time: 0.768180 Aug 09 02:40:55.257802 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 24/38] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:40:54 2022] GET /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a => generated 1367 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:40:55.497120 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-72e2eee5-cf6d-4557-8f0c-6fa2d83b88df tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:40:55.498399 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-72e2eee5-cf6d-4557-8f0c-6fa2d83b88df tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] [instance: 1e614721-c888-4eaf-b834-42497e80345c] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:40:55.508803 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-72e2eee5-cf6d-4557-8f0c-6fa2d83b88df tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:40:55.509308 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-72e2eee5-cf6d-4557-8f0c-6fa2d83b88df tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:40:55.509762 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-72e2eee5-cf6d-4557-8f0c-6fa2d83b88df tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:40:55.515059 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-72e2eee5-cf6d-4557-8f0c-6fa2d83b88df tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:40:55.515679 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-72e2eee5-cf6d-4557-8f0c-6fa2d83b88df tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:40:55.516024 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-72e2eee5-cf6d-4557-8f0c-6fa2d83b88df tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:40:55.723605 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.virt.hardware [None req-476228dd-029b-4d89-b58e-a01f985ac311 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Flavor limits 0:0:0 {{(pid=124425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 02:40:55.724768 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.virt.hardware [None req-476228dd-029b-4d89-b58e-a01f985ac311 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Image limits 0:0:0 {{(pid=124425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 02:40:55.725300 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.virt.hardware [None req-476228dd-029b-4d89-b58e-a01f985ac311 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Flavor pref 0:0:0 {{(pid=124425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 02:40:55.725757 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.virt.hardware [None req-476228dd-029b-4d89-b58e-a01f985ac311 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Image pref 0:0:0 {{(pid=124425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 02:40:55.727365 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.virt.hardware [None req-476228dd-029b-4d89-b58e-a01f985ac311 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 02:40:55.745743 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-476228dd-029b-4d89-b58e-a01f985ac311 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:40:55.747499 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-476228dd-029b-4d89-b58e-a01f985ac311 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:40:55.749183 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-476228dd-029b-4d89-b58e-a01f985ac311 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:40:55.750397 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-476228dd-029b-4d89-b58e-a01f985ac311 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:40:55.753144 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-476228dd-029b-4d89-b58e-a01f985ac311 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:40:55.754047 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-476228dd-029b-4d89-b58e-a01f985ac311 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:40:55.795578 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.quota [None req-476228dd-029b-4d89-b58e-a01f985ac311 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Getting quotas for project 65aab6ab3ce94cbd93916edf9c3eedc0. Resources: {'cores', 'ram', 'instances'} {{(pid=124425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 02:40:55.813082 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.quota [None req-476228dd-029b-4d89-b58e-a01f985ac311 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Getting quotas for user 192a8abd4c7a4535a42bea7648535dc3 and project 65aab6ab3ce94cbd93916edf9c3eedc0. Resources: {'cores', 'ram', 'instances'} {{(pid=124425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 02:40:55.843595 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-476228dd-029b-4d89-b58e-a01f985ac311 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Going to run 1 instances... {{(pid=124425) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 02:40:55.846561 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-476228dd-029b-4d89-b58e-a01f985ac311 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: a587f99c-5ad7-4fa2-945e-06954d45d44d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='04a06944-b2a8-4a65-b2a6-7ed3ff18a627',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 02:40:55.885599 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_cell0:SELECT=2 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:40:55.947012 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-72e2eee5-cf6d-4557-8f0c-6fa2d83b88df tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113d48eb42524e62bfc95606f93f3736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f96c9ae9b44b91a4db2187160a5688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:40:55.959015 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-72e2eee5-cf6d-4557-8f0c-6fa2d83b88df tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] 10.222.0.20 "GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c" status: 200 len: 1313 microversion: 2.1 time: 0.465832 Aug 09 02:40:55.961380 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 25/39] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:40:55 2022] GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c => generated 1313 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:40:55.967229 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-cafa1681-5d42-4681-8801-a61c3a92d92e tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1368973613", "imageRef": "04a06944-b2a8-4a65-b2a6-7ed3ff18a627", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "92ed22b9-a5d1-438e-b0d0-2a9c0988d349"}], "security_groups": [{"name": "tempest-securitygroup--149305033"}], "key_name": "tempest-keypair-132344174", "user_data": "}} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:40:55.996046 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-476228dd-029b-4d89-b58e-a01f985ac311 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.283798 Aug 09 02:40:56.008595 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 15/40] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Aug 9 02:40:52 2022] POST /compute/v2.1/servers => generated 383 bytes in 3291 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 02:40:56.014430 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-fc09ea8b-e491-4b23-957f-e5d02c8eb06d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:40:56.016378 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-fc09ea8b-e491-4b23-957f-e5d02c8eb06d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: a587f99c-5ad7-4fa2-945e-06954d45d44d] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:40:56.190169 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-fc09ea8b-e491-4b23-957f-e5d02c8eb06d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:40:56.198265 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-fc09ea8b-e491-4b23-957f-e5d02c8eb06d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d" status: 200 len: 1221 microversion: 2.1 time: 0.188042 Aug 09 02:40:56.200945 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 16/41] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:40:56 2022] GET /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d => generated 1221 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:40:56.280332 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-16c579e4-b01e-4baf-82a7-45ad286ceea0 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:40:56.281333 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-16c579e4-b01e-4baf-82a7-45ad286ceea0 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:40:56.302437 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-16c579e4-b01e-4baf-82a7-45ad286ceea0 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:40:56.303687 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-16c579e4-b01e-4baf-82a7-45ad286ceea0 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:40:56.304359 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-16c579e4-b01e-4baf-82a7-45ad286ceea0 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:40:56.305621 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-16c579e4-b01e-4baf-82a7-45ad286ceea0 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:40:56.306276 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.network.neutron [None req-cafa1681-5d42-4681-8801-a61c3a92d92e tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] validate_networks() for [('92ed22b9-a5d1-438e-b0d0-2a9c0988d349', None, None, None, None, None)] {{(pid=124427) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 02:40:56.306823 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-16c579e4-b01e-4baf-82a7-45ad286ceea0 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:40:56.307544 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-16c579e4-b01e-4baf-82a7-45ad286ceea0 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:40:56.340570 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_cell1:SELECT=65 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:40:57.918516 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-16c579e4-b01e-4baf-82a7-45ad286ceea0 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:40:57.938378 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-16c579e4-b01e-4baf-82a7-45ad286ceea0 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a" status: 200 len: 1367 microversion: 2.1 time: 1.659984 Aug 09 02:40:57.939996 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 17/42] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:40:56 2022] GET /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a => generated 1367 bytes in 1666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:40:57.947468 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-ef296f5e-49e7-4980-92aa-ce4153318bf6 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-972291175", "imageRef": "04a06944-b2a8-4a65-b2a6-7ed3ff18a627", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:40:57.959902 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=6 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:40:58.023213 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.network.neutron [None req-ef296f5e-49e7-4980-92aa-ce4153318bf6 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] validate_networks() for [('383daeb1-4f03-438c-8857-8e6c80656675', None, None, None, None, None)] {{(pid=124425) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 02:40:58.707539 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.virt.hardware [None req-cafa1681-5d42-4681-8801-a61c3a92d92e tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Flavor limits 0:0:0 {{(pid=124427) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 02:40:58.714716 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.virt.hardware [None req-cafa1681-5d42-4681-8801-a61c3a92d92e tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Image limits 0:0:0 {{(pid=124427) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 02:40:58.717241 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.virt.hardware [None req-cafa1681-5d42-4681-8801-a61c3a92d92e tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Flavor pref 0:0:0 {{(pid=124427) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 02:40:58.718367 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.virt.hardware [None req-cafa1681-5d42-4681-8801-a61c3a92d92e tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Image pref 0:0:0 {{(pid=124427) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 02:40:58.720152 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.virt.hardware [None req-cafa1681-5d42-4681-8801-a61c3a92d92e tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124427) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 02:40:58.734412 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_cell0:SELECT=17 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:40:58.738873 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-cafa1681-5d42-4681-8801-a61c3a92d92e tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:40:58.739797 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-cafa1681-5d42-4681-8801-a61c3a92d92e tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:40:58.740491 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-cafa1681-5d42-4681-8801-a61c3a92d92e tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:40:58.741531 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-cafa1681-5d42-4681-8801-a61c3a92d92e tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:40:58.742199 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-cafa1681-5d42-4681-8801-a61c3a92d92e tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:40:58.742992 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-cafa1681-5d42-4681-8801-a61c3a92d92e tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:40:58.770883 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.quota [None req-cafa1681-5d42-4681-8801-a61c3a92d92e tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Getting quotas for project 467b42c2bec74fcbbf90d007a6e00096. Resources: {'cores', 'ram', 'instances'} {{(pid=124427) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 02:40:58.778722 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.quota [None req-cafa1681-5d42-4681-8801-a61c3a92d92e tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Getting quotas for user 2aaa8a7f386e4ccc9ab5c356cdf1704f and project 467b42c2bec74fcbbf90d007a6e00096. Resources: {'cores', 'ram', 'instances'} {{(pid=124427) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 02:40:58.796236 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-cafa1681-5d42-4681-8801-a61c3a92d92e tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Going to run 1 instances... {{(pid=124427) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 02:40:58.799853 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-cafa1681-5d42-4681-8801-a61c3a92d92e tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='04a06944-b2a8-4a65-b2a6-7ed3ff18a627',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124427) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 02:40:58.905512 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-cafa1681-5d42-4681-8801-a61c3a92d92e tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.940332 Aug 09 02:40:58.908635 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 26/43] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Aug 9 02:40:55 2022] POST /compute/v2.1/servers => generated 401 bytes in 2946 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 02:40:58.918963 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-79725fb9-e017-4fa9-bede-1c221fef9b7b tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:40:58.933805 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-79725fb9-e017-4fa9-bede-1c221fef9b7b tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] [instance: 1e614721-c888-4eaf-b834-42497e80345c] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:40:58.951325 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-79725fb9-e017-4fa9-bede-1c221fef9b7b tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:40:58.952055 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-79725fb9-e017-4fa9-bede-1c221fef9b7b tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:40:58.955275 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-79725fb9-e017-4fa9-bede-1c221fef9b7b tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:40:58.956379 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-79725fb9-e017-4fa9-bede-1c221fef9b7b tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:40:58.957012 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-79725fb9-e017-4fa9-bede-1c221fef9b7b tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:40:58.957588 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-79725fb9-e017-4fa9-bede-1c221fef9b7b tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:40:59.317826 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.virt.hardware [None req-ef296f5e-49e7-4980-92aa-ce4153318bf6 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Flavor limits 0:0:0 {{(pid=124425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 02:40:59.318380 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.virt.hardware [None req-ef296f5e-49e7-4980-92aa-ce4153318bf6 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Image limits 0:0:0 {{(pid=124425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 02:40:59.318906 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.virt.hardware [None req-ef296f5e-49e7-4980-92aa-ce4153318bf6 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Flavor pref 0:0:0 {{(pid=124425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 02:40:59.319702 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.virt.hardware [None req-ef296f5e-49e7-4980-92aa-ce4153318bf6 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Image pref 0:0:0 {{(pid=124425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 02:40:59.320113 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.virt.hardware [None req-ef296f5e-49e7-4980-92aa-ce4153318bf6 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 02:40:59.340708 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ef296f5e-49e7-4980-92aa-ce4153318bf6 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:40:59.342130 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ef296f5e-49e7-4980-92aa-ce4153318bf6 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:40:59.342967 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ef296f5e-49e7-4980-92aa-ce4153318bf6 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:40:59.345038 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ef296f5e-49e7-4980-92aa-ce4153318bf6 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:40:59.345515 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ef296f5e-49e7-4980-92aa-ce4153318bf6 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:40:59.345939 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ef296f5e-49e7-4980-92aa-ce4153318bf6 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:40:59.346819 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-79725fb9-e017-4fa9-bede-1c221fef9b7b tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113d48eb42524e62bfc95606f93f3736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f96c9ae9b44b91a4db2187160a5688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:40:59.359188 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-79725fb9-e017-4fa9-bede-1c221fef9b7b tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] 10.222.0.20 "GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c" status: 200 len: 1313 microversion: 2.1 time: 0.449155 Aug 09 02:40:59.362471 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 27/44] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:40:58 2022] GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c => generated 1313 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:40:59.371933 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.quota [None req-ef296f5e-49e7-4980-92aa-ce4153318bf6 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Getting quotas for project 65aab6ab3ce94cbd93916edf9c3eedc0. Resources: {'cores', 'ram', 'instances'} {{(pid=124425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 02:40:59.377392 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.quota [None req-ef296f5e-49e7-4980-92aa-ce4153318bf6 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Getting quotas for user 192a8abd4c7a4535a42bea7648535dc3 and project 65aab6ab3ce94cbd93916edf9c3eedc0. Resources: {'cores', 'ram', 'instances'} {{(pid=124425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 02:40:59.402351 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-ef296f5e-49e7-4980-92aa-ce4153318bf6 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Going to run 1 instances... {{(pid=124425) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 02:40:59.406532 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-ef296f5e-49e7-4980-92aa-ce4153318bf6 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='04a06944-b2a8-4a65-b2a6-7ed3ff18a627',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 02:40:59.521495 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-ef296f5e-49e7-4980-92aa-ce4153318bf6 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.579980 Aug 09 02:40:59.522174 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 18/45] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Aug 9 02:40:57 2022] POST /compute/v2.1/servers => generated 383 bytes in 1581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 02:40:59.683854 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [req-a6e392f2-dce7-4d8d-a5f3-a5956c7e1dcc req-7d921f38-09d2-4231-b374-7ba82806e6f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a", "tag": "78354ed7-300a-4712-933c-8e98c2dff363"}]} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:40:59.709979 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-a6e392f2-dce7-4d8d-a5f3-a5956c7e1dcc req-7d921f38-09d2-4231-b374-7ba82806e6f5 service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:40:59.710623 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-a6e392f2-dce7-4d8d-a5f3-a5956c7e1dcc req-7d921f38-09d2-4231-b374-7ba82806e6f5 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:40:59.710962 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-a6e392f2-dce7-4d8d-a5f3-a5956c7e1dcc req-7d921f38-09d2-4231-b374-7ba82806e6f5 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:40:59.759453 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.compute.server_external_events [req-a6e392f2-dce7-4d8d-a5f3-a5956c7e1dcc req-7d921f38-09d2-4231-b374-7ba82806e6f5 service nova] Creating event network-changed:78354ed7-300a-4712-933c-8e98c2dff363 for instance e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a on hv-cinder-85246 Aug 09 02:40:59.760038 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-a6e392f2-dce7-4d8d-a5f3-a5956c7e1dcc req-7d921f38-09d2-4231-b374-7ba82806e6f5 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=124427) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 09 02:40:59.760422 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-a6e392f2-dce7-4d8d-a5f3-a5956c7e1dcc req-7d921f38-09d2-4231-b374-7ba82806e6f5 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124427) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 09 02:40:59.761692 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0d115674-ee19-4237-8e34-792e178ba550 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:40:59.762185 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0d115674-ee19-4237-8e34-792e178ba550 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:40:59.762593 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0d115674-ee19-4237-8e34-792e178ba550 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:40:59.767123 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0d115674-ee19-4237-8e34-792e178ba550 None None] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:40:59.768315 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0d115674-ee19-4237-8e34-792e178ba550 None None] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:40:59.768788 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0d115674-ee19-4237-8e34-792e178ba550 None None] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:40:59.792934 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.compute.rpcapi [None req-0d115674-ee19-4237-8e34-792e178ba550 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 09 02:40:59.794015 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0d115674-ee19-4237-8e34-792e178ba550 None None] Releasing lock "compute-rpcapi-router" {{(pid=124427) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 09 02:40:59.811843 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [req-20524b43-7126-4e3d-a2e2-f56cf9aeefa9 req-f7e4e696-7080-41fc-ba6c-b22596f9228b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e614721-c888-4eaf-b834-42497e80345c", "name": "network-vif-plugged", "status": "completed", "tag": "d01cee1a-247a-4147-8cbe-c15281979780"}]} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:40:59.813549 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-0d115674-ee19-4237-8e34-792e178ba550 None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.432966 Aug 09 02:40:59.814931 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 28/46] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:40:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:40:59.823068 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-9de2c88c-f08b-4131-923b-3fa63f4e09f9 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:40:59.824630 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-9de2c88c-f08b-4131-923b-3fa63f4e09f9 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:40:59.825969 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-20524b43-7126-4e3d-a2e2-f56cf9aeefa9 req-f7e4e696-7080-41fc-ba6c-b22596f9228b service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:40:59.833286 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9de2c88c-f08b-4131-923b-3fa63f4e09f9 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:40:59.834098 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9de2c88c-f08b-4131-923b-3fa63f4e09f9 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:40:59.838561 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-20524b43-7126-4e3d-a2e2-f56cf9aeefa9 req-f7e4e696-7080-41fc-ba6c-b22596f9228b service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:40:59.840160 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-20524b43-7126-4e3d-a2e2-f56cf9aeefa9 req-f7e4e696-7080-41fc-ba6c-b22596f9228b service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:40:59.845560 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9de2c88c-f08b-4131-923b-3fa63f4e09f9 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:40:59.846912 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9de2c88c-f08b-4131-923b-3fa63f4e09f9 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:40:59.847495 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9de2c88c-f08b-4131-923b-3fa63f4e09f9 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:40:59.847984 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9de2c88c-f08b-4131-923b-3fa63f4e09f9 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:40:59.862981 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.compute.server_external_events [req-20524b43-7126-4e3d-a2e2-f56cf9aeefa9 req-f7e4e696-7080-41fc-ba6c-b22596f9228b service nova] Creating event network-vif-plugged:d01cee1a-247a-4147-8cbe-c15281979780 for instance 1e614721-c888-4eaf-b834-42497e80345c on hv-cinder-85246 Aug 09 02:40:59.874554 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [req-20524b43-7126-4e3d-a2e2-f56cf9aeefa9 req-f7e4e696-7080-41fc-ba6c-b22596f9228b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.341195 Aug 09 02:40:59.878100 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 19/47] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:40:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:40:59.890207 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-9f550d5a-fb5a-4ebb-8985-f783f1708100 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:40:59.891075 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-9f550d5a-fb5a-4ebb-8985-f783f1708100 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:40:59.901081 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9f550d5a-fb5a-4ebb-8985-f783f1708100 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:40:59.901990 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9f550d5a-fb5a-4ebb-8985-f783f1708100 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:40:59.902739 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9f550d5a-fb5a-4ebb-8985-f783f1708100 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:40:59.904061 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9f550d5a-fb5a-4ebb-8985-f783f1708100 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:40:59.904894 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9f550d5a-fb5a-4ebb-8985-f783f1708100 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:40:59.905494 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9f550d5a-fb5a-4ebb-8985-f783f1708100 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:40:59.931990 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-9de2c88c-f08b-4131-923b-3fa63f4e09f9 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:40:59.940594 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-9de2c88c-f08b-4131-923b-3fa63f4e09f9 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 200 len: 1241 microversion: 2.1 time: 0.123574 Aug 09 02:40:59.951096 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 29/48] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:40:59 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 1241 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:40:59.971131 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-07d24fb2-d401-41b6-8570-12d5de341d16 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:40:59.972057 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-07d24fb2-d401-41b6-8570-12d5de341d16 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:00.062443 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-07d24fb2-d401-41b6-8570-12d5de341d16 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:00.073389 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-07d24fb2-d401-41b6-8570-12d5de341d16 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507" status: 200 len: 1221 microversion: 2.1 time: 0.120585 Aug 09 02:41:00.077814 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 30/49] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:40:59 2022] GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507 => generated 1221 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:00.152717 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-9f550d5a-fb5a-4ebb-8985-f783f1708100 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:00.176465 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-9f550d5a-fb5a-4ebb-8985-f783f1708100 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a" status: 200 len: 1367 microversion: 2.1 time: 0.296714 Aug 09 02:41:00.179088 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 20/50] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:40:59 2022] GET /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a => generated 1367 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:00.381383 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-5c5b7813-941b-439e-b99f-4bd33fff8122 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:00.381997 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-5c5b7813-941b-439e-b99f-4bd33fff8122 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] [instance: 1e614721-c888-4eaf-b834-42497e80345c] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:00.388108 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5c5b7813-941b-439e-b99f-4bd33fff8122 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:00.388590 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5c5b7813-941b-439e-b99f-4bd33fff8122 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:00.389002 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5c5b7813-941b-439e-b99f-4bd33fff8122 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:00.389834 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5c5b7813-941b-439e-b99f-4bd33fff8122 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:00.390437 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5c5b7813-941b-439e-b99f-4bd33fff8122 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:00.391004 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5c5b7813-941b-439e-b99f-4bd33fff8122 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:00.535810 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-5c5b7813-941b-439e-b99f-4bd33fff8122 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113d48eb42524e62bfc95606f93f3736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f96c9ae9b44b91a4db2187160a5688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:00.543608 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-5c5b7813-941b-439e-b99f-4bd33fff8122 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] 10.222.0.20 "GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c" status: 200 len: 1313 microversion: 2.1 time: 0.166611 Aug 09 02:41:00.544214 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 31/51] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:00 2022] GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:00.962091 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-5f13822c-0752-4ecb-9fe9-3948cd06c456 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:00.962762 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-5f13822c-0752-4ecb-9fe9-3948cd06c456 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:00.969798 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-5f13822c-0752-4ecb-9fe9-3948cd06c456 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:00.972153 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-5f13822c-0752-4ecb-9fe9-3948cd06c456 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:00.972695 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-5f13822c-0752-4ecb-9fe9-3948cd06c456 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:00.973306 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-5f13822c-0752-4ecb-9fe9-3948cd06c456 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:00.973759 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-5f13822c-0752-4ecb-9fe9-3948cd06c456 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:00.974202 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-5f13822c-0752-4ecb-9fe9-3948cd06c456 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:01.049624 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-5f13822c-0752-4ecb-9fe9-3948cd06c456 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:01.057245 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-5f13822c-0752-4ecb-9fe9-3948cd06c456 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 200 len: 1241 microversion: 2.1 time: 0.099481 Aug 09 02:41:01.057826 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 21/52] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:00 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 1241 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:01.099789 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-a8276660-1ae8-46a5-82a8-4bf874064667 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:01.100674 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-a8276660-1ae8-46a5-82a8-4bf874064667 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:01.107015 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a8276660-1ae8-46a5-82a8-4bf874064667 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:01.107745 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a8276660-1ae8-46a5-82a8-4bf874064667 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:01.108317 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a8276660-1ae8-46a5-82a8-4bf874064667 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:01.109305 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a8276660-1ae8-46a5-82a8-4bf874064667 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:01.109840 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a8276660-1ae8-46a5-82a8-4bf874064667 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:01.110343 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a8276660-1ae8-46a5-82a8-4bf874064667 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:01.178884 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-a8276660-1ae8-46a5-82a8-4bf874064667 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:01.187040 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-a8276660-1ae8-46a5-82a8-4bf874064667 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507" status: 200 len: 1225 microversion: 2.1 time: 0.091890 Aug 09 02:41:01.187759 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 32/53] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:01 2022] GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:01.196937 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-511d51a9-660b-4725-a1b3-bd7b8999d517 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:01.197749 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-511d51a9-660b-4725-a1b3-bd7b8999d517 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:01.205056 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-511d51a9-660b-4725-a1b3-bd7b8999d517 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:01.205780 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-511d51a9-660b-4725-a1b3-bd7b8999d517 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:01.206531 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-511d51a9-660b-4725-a1b3-bd7b8999d517 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:01.210013 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-511d51a9-660b-4725-a1b3-bd7b8999d517 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:01.210729 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-511d51a9-660b-4725-a1b3-bd7b8999d517 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:01.211483 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-511d51a9-660b-4725-a1b3-bd7b8999d517 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:01.354218 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-511d51a9-660b-4725-a1b3-bd7b8999d517 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:01.362639 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-511d51a9-660b-4725-a1b3-bd7b8999d517 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a" status: 200 len: 1367 microversion: 2.1 time: 0.169445 Aug 09 02:41:01.363537 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 22/54] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:01 2022] GET /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:01.565333 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-a7a0f68a-f3c0-4bed-b660-53471d0eabd4 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:01.566032 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-a7a0f68a-f3c0-4bed-b660-53471d0eabd4 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] [instance: 1e614721-c888-4eaf-b834-42497e80345c] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:01.572393 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a7a0f68a-f3c0-4bed-b660-53471d0eabd4 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:01.573137 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a7a0f68a-f3c0-4bed-b660-53471d0eabd4 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:01.574529 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a7a0f68a-f3c0-4bed-b660-53471d0eabd4 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:01.575472 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a7a0f68a-f3c0-4bed-b660-53471d0eabd4 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:01.576197 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a7a0f68a-f3c0-4bed-b660-53471d0eabd4 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:01.576952 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a7a0f68a-f3c0-4bed-b660-53471d0eabd4 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:01.786676 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-a7a0f68a-f3c0-4bed-b660-53471d0eabd4 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113d48eb42524e62bfc95606f93f3736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f96c9ae9b44b91a4db2187160a5688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:01.795341 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-a7a0f68a-f3c0-4bed-b660-53471d0eabd4 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] 10.222.0.20 "GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c" status: 200 len: 1313 microversion: 2.1 time: 0.233519 Aug 09 02:41:01.796572 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 33/55] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:01 2022] GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c => generated 1313 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:02.086070 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-a45c6bb4-5cd4-46d2-93b6-7b6ceb66dd05 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:02.087019 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-a45c6bb4-5cd4-46d2-93b6-7b6ceb66dd05 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:02.093930 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a45c6bb4-5cd4-46d2-93b6-7b6ceb66dd05 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:02.094802 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a45c6bb4-5cd4-46d2-93b6-7b6ceb66dd05 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:02.095436 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a45c6bb4-5cd4-46d2-93b6-7b6ceb66dd05 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:02.096333 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a45c6bb4-5cd4-46d2-93b6-7b6ceb66dd05 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:02.097168 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a45c6bb4-5cd4-46d2-93b6-7b6ceb66dd05 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:02.097963 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a45c6bb4-5cd4-46d2-93b6-7b6ceb66dd05 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:02.216986 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-e450c6f4-d60b-40ef-b068-a491468785ce tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:02.218022 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-e450c6f4-d60b-40ef-b068-a491468785ce tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:02.227418 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e450c6f4-d60b-40ef-b068-a491468785ce tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:02.227903 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e450c6f4-d60b-40ef-b068-a491468785ce tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:02.230000 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e450c6f4-d60b-40ef-b068-a491468785ce tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:02.230892 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e450c6f4-d60b-40ef-b068-a491468785ce tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:02.231352 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e450c6f4-d60b-40ef-b068-a491468785ce tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:02.231772 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e450c6f4-d60b-40ef-b068-a491468785ce tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:02.236835 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-a45c6bb4-5cd4-46d2-93b6-7b6ceb66dd05 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:02.248494 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-a45c6bb4-5cd4-46d2-93b6-7b6ceb66dd05 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 200 len: 1233 microversion: 2.1 time: 0.171188 Aug 09 02:41:02.249094 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 23/56] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:02 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 1233 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:02.314122 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-e450c6f4-d60b-40ef-b068-a491468785ce tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:02.318330 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [req-262390c3-a03d-49de-ad65-32d141baa8e5 req-445e4e59-03e2-4dd9-b458-c94aabd75306 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a587f99c-5ad7-4fa2-945e-06954d45d44d", "tag": "6db685d1-484e-4847-8638-637842940e30"}]} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:41:02.322208 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-e450c6f4-d60b-40ef-b068-a491468785ce tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507" status: 200 len: 1225 microversion: 2.1 time: 0.116796 Aug 09 02:41:02.323869 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 34/57] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:02 2022] GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507 => generated 1225 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:02.341375 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-262390c3-a03d-49de-ad65-32d141baa8e5 req-445e4e59-03e2-4dd9-b458-c94aabd75306 service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:02.344549 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-262390c3-a03d-49de-ad65-32d141baa8e5 req-445e4e59-03e2-4dd9-b458-c94aabd75306 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:02.345099 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-262390c3-a03d-49de-ad65-32d141baa8e5 req-445e4e59-03e2-4dd9-b458-c94aabd75306 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:02.358515 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.compute.server_external_events [req-262390c3-a03d-49de-ad65-32d141baa8e5 req-445e4e59-03e2-4dd9-b458-c94aabd75306 service nova] Creating event network-changed:6db685d1-484e-4847-8638-637842940e30 for instance a587f99c-5ad7-4fa2-945e-06954d45d44d on hv-cinder-85246 Aug 09 02:41:02.365093 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [req-262390c3-a03d-49de-ad65-32d141baa8e5 req-445e4e59-03e2-4dd9-b458-c94aabd75306 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050829 Aug 09 02:41:02.365701 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 24/58] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:41:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:41:02.385065 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-9f08341b-ff50-4772-b33a-f364ea05070c tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:02.385689 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-9f08341b-ff50-4772-b33a-f364ea05070c tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:02.395452 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9f08341b-ff50-4772-b33a-f364ea05070c tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:02.395952 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9f08341b-ff50-4772-b33a-f364ea05070c tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:02.396384 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9f08341b-ff50-4772-b33a-f364ea05070c tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:02.399253 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9f08341b-ff50-4772-b33a-f364ea05070c tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:02.399728 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9f08341b-ff50-4772-b33a-f364ea05070c tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:02.400146 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9f08341b-ff50-4772-b33a-f364ea05070c tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:02.819353 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-2da2d2d9-9ed3-43aa-95d2-c60e7930919f tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:02.820060 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-2da2d2d9-9ed3-43aa-95d2-c60e7930919f tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] [instance: 1e614721-c888-4eaf-b834-42497e80345c] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:02.829905 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2da2d2d9-9ed3-43aa-95d2-c60e7930919f tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:02.835854 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2da2d2d9-9ed3-43aa-95d2-c60e7930919f tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:02.837645 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2da2d2d9-9ed3-43aa-95d2-c60e7930919f tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:02.840006 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2da2d2d9-9ed3-43aa-95d2-c60e7930919f tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:02.845480 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2da2d2d9-9ed3-43aa-95d2-c60e7930919f tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:02.847367 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2da2d2d9-9ed3-43aa-95d2-c60e7930919f tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:03.039893 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-9f08341b-ff50-4772-b33a-f364ea05070c tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:03.052758 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-9f08341b-ff50-4772-b33a-f364ea05070c tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a" status: 200 len: 1367 microversion: 2.1 time: 0.671842 Aug 09 02:41:03.053370 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 35/59] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:02 2022] GET /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a => generated 1367 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:03.270267 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-69698a05-8b1d-4999-93d6-6f2c5ebeb9a5 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:03.271658 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-69698a05-8b1d-4999-93d6-6f2c5ebeb9a5 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:03.287201 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-69698a05-8b1d-4999-93d6-6f2c5ebeb9a5 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:03.288399 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-69698a05-8b1d-4999-93d6-6f2c5ebeb9a5 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:03.291824 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-69698a05-8b1d-4999-93d6-6f2c5ebeb9a5 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:03.292816 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-69698a05-8b1d-4999-93d6-6f2c5ebeb9a5 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:03.294243 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-69698a05-8b1d-4999-93d6-6f2c5ebeb9a5 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:03.295335 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-69698a05-8b1d-4999-93d6-6f2c5ebeb9a5 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:03.863088 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-2da2d2d9-9ed3-43aa-95d2-c60e7930919f tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113d48eb42524e62bfc95606f93f3736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f96c9ae9b44b91a4db2187160a5688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:03.873671 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-2da2d2d9-9ed3-43aa-95d2-c60e7930919f tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] 10.222.0.20 "GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c" status: 200 len: 1313 microversion: 2.1 time: 1.060196 Aug 09 02:41:03.875354 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 25/60] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:02 2022] GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c => generated 1313 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:03.881320 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-7c042fc6-f078-4023-b278-87f06bd82ba5 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:03.881935 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-7c042fc6-f078-4023-b278-87f06bd82ba5 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:03.888421 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7c042fc6-f078-4023-b278-87f06bd82ba5 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:03.889065 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7c042fc6-f078-4023-b278-87f06bd82ba5 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:03.889769 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7c042fc6-f078-4023-b278-87f06bd82ba5 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:03.892706 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7c042fc6-f078-4023-b278-87f06bd82ba5 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:03.894013 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7c042fc6-f078-4023-b278-87f06bd82ba5 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:03.894800 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7c042fc6-f078-4023-b278-87f06bd82ba5 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:03.932181 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-69698a05-8b1d-4999-93d6-6f2c5ebeb9a5 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:03.944163 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-69698a05-8b1d-4999-93d6-6f2c5ebeb9a5 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 200 len: 1297 microversion: 2.1 time: 0.677708 Aug 09 02:41:03.947095 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 36/61] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:03 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 1297 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:41:04.064248 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-7c042fc6-f078-4023-b278-87f06bd82ba5 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:04.074276 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-072e2b80-51be-437b-9848-6cc77880d241 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:04.075160 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-072e2b80-51be-437b-9848-6cc77880d241 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:04.077261 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-7c042fc6-f078-4023-b278-87f06bd82ba5 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507" status: 200 len: 1273 microversion: 2.1 time: 0.199500 Aug 09 02:41:04.078329 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 26/62] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:03 2022] GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507 => generated 1273 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:04.093409 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-072e2b80-51be-437b-9848-6cc77880d241 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:04.094121 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-072e2b80-51be-437b-9848-6cc77880d241 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:04.095819 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-072e2b80-51be-437b-9848-6cc77880d241 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:04.097319 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-072e2b80-51be-437b-9848-6cc77880d241 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:04.098843 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-072e2b80-51be-437b-9848-6cc77880d241 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:04.099368 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-072e2b80-51be-437b-9848-6cc77880d241 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:04.244205 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-072e2b80-51be-437b-9848-6cc77880d241 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:04.252874 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-072e2b80-51be-437b-9848-6cc77880d241 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a" status: 200 len: 1367 microversion: 2.1 time: 0.183892 Aug 09 02:41:04.253728 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 37/63] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:04 2022] GET /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:41:04.895258 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-e0f294f0-8b51-4e56-847a-c3cc5082f774 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:04.895961 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-e0f294f0-8b51-4e56-847a-c3cc5082f774 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] [instance: 1e614721-c888-4eaf-b834-42497e80345c] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:04.901916 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e0f294f0-8b51-4e56-847a-c3cc5082f774 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:04.902490 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e0f294f0-8b51-4e56-847a-c3cc5082f774 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:04.902982 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e0f294f0-8b51-4e56-847a-c3cc5082f774 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:04.903653 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e0f294f0-8b51-4e56-847a-c3cc5082f774 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:04.904098 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e0f294f0-8b51-4e56-847a-c3cc5082f774 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:04.904507 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e0f294f0-8b51-4e56-847a-c3cc5082f774 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:04.968003 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-5a3a62e8-79ba-46af-818e-f5868c0af496 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:04.968726 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-5a3a62e8-79ba-46af-818e-f5868c0af496 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:04.975263 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5a3a62e8-79ba-46af-818e-f5868c0af496 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:04.975755 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5a3a62e8-79ba-46af-818e-f5868c0af496 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:04.976259 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5a3a62e8-79ba-46af-818e-f5868c0af496 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:04.977021 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5a3a62e8-79ba-46af-818e-f5868c0af496 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:04.977541 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5a3a62e8-79ba-46af-818e-f5868c0af496 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:04.978059 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5a3a62e8-79ba-46af-818e-f5868c0af496 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:05.064004 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-5a3a62e8-79ba-46af-818e-f5868c0af496 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:05.071877 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-5a3a62e8-79ba-46af-818e-f5868c0af496 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 200 len: 1307 microversion: 2.1 time: 0.107734 Aug 09 02:41:05.072418 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 38/64] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:04 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 1307 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:05.100915 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-e7a98272-81a8-43d1-9770-b84e7104660b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:05.101868 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-e7a98272-81a8-43d1-9770-b84e7104660b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:05.102387 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-e0f294f0-8b51-4e56-847a-c3cc5082f774 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113d48eb42524e62bfc95606f93f3736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f96c9ae9b44b91a4db2187160a5688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:05.114689 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-e0f294f0-8b51-4e56-847a-c3cc5082f774 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] 10.222.0.20 "GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c" status: 200 len: 1313 microversion: 2.1 time: 0.223209 Aug 09 02:41:05.116048 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 27/65] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:04 2022] GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:05.121252 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e7a98272-81a8-43d1-9770-b84e7104660b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:05.121757 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e7a98272-81a8-43d1-9770-b84e7104660b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:05.122220 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e7a98272-81a8-43d1-9770-b84e7104660b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:05.122938 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e7a98272-81a8-43d1-9770-b84e7104660b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:05.123505 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e7a98272-81a8-43d1-9770-b84e7104660b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:05.123938 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e7a98272-81a8-43d1-9770-b84e7104660b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:05.216920 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-e7a98272-81a8-43d1-9770-b84e7104660b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:05.227689 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-e7a98272-81a8-43d1-9770-b84e7104660b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507" status: 200 len: 1273 microversion: 2.1 time: 0.132716 Aug 09 02:41:05.228251 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 39/66] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:05 2022] GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507 => generated 1273 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:41:05.273024 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-dee73178-d6d6-4567-9d01-f738327c9918 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:05.273646 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-dee73178-d6d6-4567-9d01-f738327c9918 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:05.279706 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-dee73178-d6d6-4567-9d01-f738327c9918 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:05.280180 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-dee73178-d6d6-4567-9d01-f738327c9918 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:05.280604 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-dee73178-d6d6-4567-9d01-f738327c9918 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:05.281519 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-dee73178-d6d6-4567-9d01-f738327c9918 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:05.281964 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-dee73178-d6d6-4567-9d01-f738327c9918 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:05.282407 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-dee73178-d6d6-4567-9d01-f738327c9918 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:05.426552 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-dee73178-d6d6-4567-9d01-f738327c9918 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:05.434781 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-dee73178-d6d6-4567-9d01-f738327c9918 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a" status: 200 len: 1367 microversion: 2.1 time: 0.165736 Aug 09 02:41:05.436746 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 28/67] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:05 2022] GET /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:06.092945 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-768bbfe9-8262-4467-8000-d7b24b97b7da tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:06.093558 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-768bbfe9-8262-4467-8000-d7b24b97b7da tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:06.099979 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-768bbfe9-8262-4467-8000-d7b24b97b7da tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:06.100461 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-768bbfe9-8262-4467-8000-d7b24b97b7da tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:06.100889 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-768bbfe9-8262-4467-8000-d7b24b97b7da tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:06.101571 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-768bbfe9-8262-4467-8000-d7b24b97b7da tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:06.102184 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-768bbfe9-8262-4467-8000-d7b24b97b7da tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:06.102604 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-768bbfe9-8262-4467-8000-d7b24b97b7da tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:06.136438 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-65a7f68e-15c7-4225-91c2-b629c4c8fea7 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:06.137693 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-65a7f68e-15c7-4225-91c2-b629c4c8fea7 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] [instance: 1e614721-c888-4eaf-b834-42497e80345c] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:06.159142 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-65a7f68e-15c7-4225-91c2-b629c4c8fea7 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:06.160016 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-65a7f68e-15c7-4225-91c2-b629c4c8fea7 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:06.160633 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-65a7f68e-15c7-4225-91c2-b629c4c8fea7 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:06.161663 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-65a7f68e-15c7-4225-91c2-b629c4c8fea7 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:06.162522 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-65a7f68e-15c7-4225-91c2-b629c4c8fea7 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:06.163087 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-65a7f68e-15c7-4225-91c2-b629c4c8fea7 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:06.176964 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-768bbfe9-8262-4467-8000-d7b24b97b7da tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:06.189222 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-768bbfe9-8262-4467-8000-d7b24b97b7da tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 200 len: 1307 microversion: 2.1 time: 0.100073 Aug 09 02:41:06.190291 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 40/68] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:06 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 1307 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:06.249033 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-923fc700-a3ba-49aa-8f67-8f390ed8df5a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:06.249829 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-923fc700-a3ba-49aa-8f67-8f390ed8df5a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:06.256194 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-923fc700-a3ba-49aa-8f67-8f390ed8df5a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:06.256885 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-923fc700-a3ba-49aa-8f67-8f390ed8df5a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:06.257410 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-923fc700-a3ba-49aa-8f67-8f390ed8df5a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:06.258279 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-923fc700-a3ba-49aa-8f67-8f390ed8df5a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:06.258907 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-923fc700-a3ba-49aa-8f67-8f390ed8df5a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:06.259455 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-923fc700-a3ba-49aa-8f67-8f390ed8df5a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:06.339185 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-923fc700-a3ba-49aa-8f67-8f390ed8df5a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:06.341669 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_cell1:SELECT=100 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:41:06.349350 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-923fc700-a3ba-49aa-8f67-8f390ed8df5a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507" status: 200 len: 1273 microversion: 2.1 time: 0.104499 Aug 09 02:41:06.350337 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 41/69] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:06 2022] GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507 => generated 1273 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:41:06.401698 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-65a7f68e-15c7-4225-91c2-b629c4c8fea7 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113d48eb42524e62bfc95606f93f3736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f96c9ae9b44b91a4db2187160a5688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:06.419969 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-65a7f68e-15c7-4225-91c2-b629c4c8fea7 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] 10.222.0.20 "GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c" status: 200 len: 1313 microversion: 2.1 time: 0.287303 Aug 09 02:41:06.421352 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 29/70] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:06 2022] GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c => generated 1313 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:06.457994 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-6bb5530c-3e3b-441c-ba77-4a1dde1e4cb5 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:06.458769 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-6bb5530c-3e3b-441c-ba77-4a1dde1e4cb5 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:06.465198 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6bb5530c-3e3b-441c-ba77-4a1dde1e4cb5 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:06.465769 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6bb5530c-3e3b-441c-ba77-4a1dde1e4cb5 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:06.466814 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6bb5530c-3e3b-441c-ba77-4a1dde1e4cb5 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:06.467899 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6bb5530c-3e3b-441c-ba77-4a1dde1e4cb5 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:06.468444 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6bb5530c-3e3b-441c-ba77-4a1dde1e4cb5 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:06.468927 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6bb5530c-3e3b-441c-ba77-4a1dde1e4cb5 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:06.714215 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-6bb5530c-3e3b-441c-ba77-4a1dde1e4cb5 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:06.731193 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-6bb5530c-3e3b-441c-ba77-4a1dde1e4cb5 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a" status: 200 len: 1367 microversion: 2.1 time: 0.278106 Aug 09 02:41:06.731801 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 42/71] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:06 2022] GET /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a => generated 1367 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:07.213582 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-87dfec89-4a9b-4e9d-a223-c2c5a2a194a0 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:07.214225 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-87dfec89-4a9b-4e9d-a223-c2c5a2a194a0 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:07.222175 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-87dfec89-4a9b-4e9d-a223-c2c5a2a194a0 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:07.222677 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-87dfec89-4a9b-4e9d-a223-c2c5a2a194a0 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:07.226131 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-87dfec89-4a9b-4e9d-a223-c2c5a2a194a0 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:07.227766 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-87dfec89-4a9b-4e9d-a223-c2c5a2a194a0 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:07.229047 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-87dfec89-4a9b-4e9d-a223-c2c5a2a194a0 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:07.229689 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-87dfec89-4a9b-4e9d-a223-c2c5a2a194a0 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:07.370927 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-2a63f7a3-6d26-4e64-b2e2-3dc01cedbd25 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:07.371555 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-2a63f7a3-6d26-4e64-b2e2-3dc01cedbd25 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:07.393017 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-87dfec89-4a9b-4e9d-a223-c2c5a2a194a0 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:07.396906 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2a63f7a3-6d26-4e64-b2e2-3dc01cedbd25 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:07.401769 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2a63f7a3-6d26-4e64-b2e2-3dc01cedbd25 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:07.405375 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-87dfec89-4a9b-4e9d-a223-c2c5a2a194a0 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 200 len: 1295 microversion: 2.1 time: 0.195972 Aug 09 02:41:07.420769 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2a63f7a3-6d26-4e64-b2e2-3dc01cedbd25 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:07.422759 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 30/72] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:07 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 1295 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:07.423429 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2a63f7a3-6d26-4e64-b2e2-3dc01cedbd25 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:07.425962 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2a63f7a3-6d26-4e64-b2e2-3dc01cedbd25 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:07.427725 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2a63f7a3-6d26-4e64-b2e2-3dc01cedbd25 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:07.445427 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-122e0aee-c3a6-4f0d-af90-537bda8b0ebd tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:07.446649 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-122e0aee-c3a6-4f0d-af90-537bda8b0ebd tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] [instance: 1e614721-c888-4eaf-b834-42497e80345c] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:07.469866 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-122e0aee-c3a6-4f0d-af90-537bda8b0ebd tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:07.472691 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-122e0aee-c3a6-4f0d-af90-537bda8b0ebd tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:07.478123 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-122e0aee-c3a6-4f0d-af90-537bda8b0ebd tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:07.479451 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-122e0aee-c3a6-4f0d-af90-537bda8b0ebd tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:07.488744 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-122e0aee-c3a6-4f0d-af90-537bda8b0ebd tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:07.490479 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-122e0aee-c3a6-4f0d-af90-537bda8b0ebd tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:07.647562 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-2a63f7a3-6d26-4e64-b2e2-3dc01cedbd25 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:07.664138 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-2a63f7a3-6d26-4e64-b2e2-3dc01cedbd25 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507" status: 200 len: 1279 microversion: 2.1 time: 0.289888 Aug 09 02:41:07.664808 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 43/73] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:07 2022] GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507 => generated 1279 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:41:07.752450 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-f6fc3922-3a17-44ce-b76d-20c3f82ab32f tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:07.753198 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-f6fc3922-3a17-44ce-b76d-20c3f82ab32f tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:07.760085 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-f6fc3922-3a17-44ce-b76d-20c3f82ab32f tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:07.766319 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-f6fc3922-3a17-44ce-b76d-20c3f82ab32f tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:07.767133 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-f6fc3922-3a17-44ce-b76d-20c3f82ab32f tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:07.768082 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-f6fc3922-3a17-44ce-b76d-20c3f82ab32f tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:07.768945 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-f6fc3922-3a17-44ce-b76d-20c3f82ab32f tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:07.769578 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-f6fc3922-3a17-44ce-b76d-20c3f82ab32f tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:08.236302 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-122e0aee-c3a6-4f0d-af90-537bda8b0ebd tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113d48eb42524e62bfc95606f93f3736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f96c9ae9b44b91a4db2187160a5688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:08.245204 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-122e0aee-c3a6-4f0d-af90-537bda8b0ebd tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] 10.222.0.20 "GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c" status: 200 len: 1313 microversion: 2.1 time: 0.807889 Aug 09 02:41:08.258491 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 31/74] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:07 2022] GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c => generated 1313 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:08.264142 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [req-0b5af835-0175-47db-8b47-44f10255315a req-c0a4a960-26fd-4074-b0c4-6f63443b3aa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a", "name": "network-vif-plugged", "status": "completed", "tag": "78354ed7-300a-4712-933c-8e98c2dff363"}]} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:41:08.274763 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-0b5af835-0175-47db-8b47-44f10255315a req-c0a4a960-26fd-4074-b0c4-6f63443b3aa5 service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:08.275555 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-0b5af835-0175-47db-8b47-44f10255315a req-c0a4a960-26fd-4074-b0c4-6f63443b3aa5 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:08.276201 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-0b5af835-0175-47db-8b47-44f10255315a req-c0a4a960-26fd-4074-b0c4-6f63443b3aa5 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:08.292840 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.compute.server_external_events [req-0b5af835-0175-47db-8b47-44f10255315a req-c0a4a960-26fd-4074-b0c4-6f63443b3aa5 service nova] Creating event network-vif-plugged:78354ed7-300a-4712-933c-8e98c2dff363 for instance e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a on hv-cinder-85246 Aug 09 02:41:08.298706 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [req-0b5af835-0175-47db-8b47-44f10255315a req-c0a4a960-26fd-4074-b0c4-6f63443b3aa5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038637 Aug 09 02:41:08.301383 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 32/75] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:41:08.434943 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-2451bfa9-b5bd-47ce-8a68-85962a6b6610 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:08.435760 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-2451bfa9-b5bd-47ce-8a68-85962a6b6610 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:08.449625 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2451bfa9-b5bd-47ce-8a68-85962a6b6610 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:08.450704 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2451bfa9-b5bd-47ce-8a68-85962a6b6610 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:08.451896 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2451bfa9-b5bd-47ce-8a68-85962a6b6610 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:08.453880 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2451bfa9-b5bd-47ce-8a68-85962a6b6610 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:08.455870 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2451bfa9-b5bd-47ce-8a68-85962a6b6610 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:08.457932 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2451bfa9-b5bd-47ce-8a68-85962a6b6610 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:08.653512 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-f6fc3922-3a17-44ce-b76d-20c3f82ab32f tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:08.671042 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-f6fc3922-3a17-44ce-b76d-20c3f82ab32f tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a" status: 200 len: 1367 microversion: 2.1 time: 0.922433 Aug 09 02:41:08.672406 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 44/76] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:07 2022] GET /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a => generated 1367 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:08.712543 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-06ec7750-893a-42a8-a0ac-338d90401d85 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:08.715462 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-06ec7750-893a-42a8-a0ac-338d90401d85 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:08.726390 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-06ec7750-893a-42a8-a0ac-338d90401d85 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:08.727182 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-06ec7750-893a-42a8-a0ac-338d90401d85 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:08.727860 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-06ec7750-893a-42a8-a0ac-338d90401d85 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:08.729233 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-06ec7750-893a-42a8-a0ac-338d90401d85 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:08.729882 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-06ec7750-893a-42a8-a0ac-338d90401d85 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:08.731042 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-06ec7750-893a-42a8-a0ac-338d90401d85 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:08.907973 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-2451bfa9-b5bd-47ce-8a68-85962a6b6610 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:08.925408 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-2451bfa9-b5bd-47ce-8a68-85962a6b6610 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 200 len: 1362 microversion: 2.1 time: 0.496535 Aug 09 02:41:08.926286 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 33/77] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:08 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 1362 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:08.934629 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-06ec7750-893a-42a8-a0ac-338d90401d85 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:08.943756 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-06ec7750-893a-42a8-a0ac-338d90401d85 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507" status: 200 len: 1321 microversion: 2.1 time: 0.248427 Aug 09 02:41:08.944487 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 45/78] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:08 2022] GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507 => generated 1321 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:09.266752 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-6f993e1f-03e2-45ad-877e-65c9aabfab7b tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:09.267376 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-6f993e1f-03e2-45ad-877e-65c9aabfab7b tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] [instance: 1e614721-c888-4eaf-b834-42497e80345c] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:09.287942 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6f993e1f-03e2-45ad-877e-65c9aabfab7b tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:09.288460 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6f993e1f-03e2-45ad-877e-65c9aabfab7b tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:09.289033 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6f993e1f-03e2-45ad-877e-65c9aabfab7b tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:09.291229 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6f993e1f-03e2-45ad-877e-65c9aabfab7b tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:09.294124 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6f993e1f-03e2-45ad-877e-65c9aabfab7b tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:09.295139 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6f993e1f-03e2-45ad-877e-65c9aabfab7b tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:09.369283 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_cell0:SELECT=6 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:41:09.390687 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_cell0:SELECT=18 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:41:09.518368 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [req-87905d9b-6165-418b-a13e-6649ff26b2bd req-ec70e617-e152-43d1-9fd8-821445b0f950 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4571cba1-e225-40c3-aa20-12c3802c6507", "tag": "8f9897d0-4b5a-4a41-9c95-c0710478bbe7"}]} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:41:09.539724 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-87905d9b-6165-418b-a13e-6649ff26b2bd req-ec70e617-e152-43d1-9fd8-821445b0f950 service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:09.540953 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-87905d9b-6165-418b-a13e-6649ff26b2bd req-ec70e617-e152-43d1-9fd8-821445b0f950 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:09.544836 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-6f993e1f-03e2-45ad-877e-65c9aabfab7b tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113d48eb42524e62bfc95606f93f3736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f96c9ae9b44b91a4db2187160a5688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:09.552377 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-87905d9b-6165-418b-a13e-6649ff26b2bd req-ec70e617-e152-43d1-9fd8-821445b0f950 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:09.557148 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-6f993e1f-03e2-45ad-877e-65c9aabfab7b tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] 10.222.0.20 "GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c" status: 200 len: 1499 microversion: 2.1 time: 0.292615 Aug 09 02:41:09.560146 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 34/79] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:09 2022] GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c => generated 1499 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:41:09.576706 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.compute.server_external_events [req-87905d9b-6165-418b-a13e-6649ff26b2bd req-ec70e617-e152-43d1-9fd8-821445b0f950 service nova] Creating event network-changed:8f9897d0-4b5a-4a41-9c95-c0710478bbe7 for instance 4571cba1-e225-40c3-aa20-12c3802c6507 on hv-cinder-85246 Aug 09 02:41:09.591368 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [req-87905d9b-6165-418b-a13e-6649ff26b2bd req-ec70e617-e152-43d1-9fd8-821445b0f950 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079564 Aug 09 02:41:09.593209 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 46/80] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:41:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 02:41:09.703915 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-50fc154e-5aae-43a0-a679-6934abd88708 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:09.704681 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-50fc154e-5aae-43a0-a679-6934abd88708 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:09.714304 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-50fc154e-5aae-43a0-a679-6934abd88708 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:09.715258 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-50fc154e-5aae-43a0-a679-6934abd88708 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:09.716103 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-50fc154e-5aae-43a0-a679-6934abd88708 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:09.717078 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-50fc154e-5aae-43a0-a679-6934abd88708 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:09.717820 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-50fc154e-5aae-43a0-a679-6934abd88708 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:09.718436 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-50fc154e-5aae-43a0-a679-6934abd88708 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:09.943570 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_cell0:SELECT=4 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:41:09.949393 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-a5945adf-5cc3-466c-b3de-1e9ec023c099 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:09.950298 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-a5945adf-5cc3-466c-b3de-1e9ec023c099 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:09.963293 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a5945adf-5cc3-466c-b3de-1e9ec023c099 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:09.965569 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a5945adf-5cc3-466c-b3de-1e9ec023c099 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:09.966269 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a5945adf-5cc3-466c-b3de-1e9ec023c099 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:09.967929 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a5945adf-5cc3-466c-b3de-1e9ec023c099 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:09.970004 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a5945adf-5cc3-466c-b3de-1e9ec023c099 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:09.974992 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-50fc154e-5aae-43a0-a679-6934abd88708 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:09.984019 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a5945adf-5cc3-466c-b3de-1e9ec023c099 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:09.991105 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-50fc154e-5aae-43a0-a679-6934abd88708 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a" status: 200 len: 1367 microversion: 2.1 time: 0.289333 Aug 09 02:41:09.992042 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 35/81] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:09 2022] GET /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a => generated 1367 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:41:10.013653 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-f8a375c6-1e86-44d4-b912-9ceba2339591 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:10.017153 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-f8a375c6-1e86-44d4-b912-9ceba2339591 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:10.030804 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f8a375c6-1e86-44d4-b912-9ceba2339591 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:10.033061 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f8a375c6-1e86-44d4-b912-9ceba2339591 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:10.033801 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f8a375c6-1e86-44d4-b912-9ceba2339591 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:10.040824 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f8a375c6-1e86-44d4-b912-9ceba2339591 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:10.041431 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f8a375c6-1e86-44d4-b912-9ceba2339591 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:10.041924 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f8a375c6-1e86-44d4-b912-9ceba2339591 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:10.071499 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_cell0:SELECT=7 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:41:10.273128 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-a5945adf-5cc3-466c-b3de-1e9ec023c099 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:10.285618 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-f8a375c6-1e86-44d4-b912-9ceba2339591 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:10.288332 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_cell1:SELECT=100 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:41:10.290800 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-a5945adf-5cc3-466c-b3de-1e9ec023c099 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 200 len: 1362 microversion: 2.1 time: 0.347373 Aug 09 02:41:10.292357 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 47/82] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:09 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 1362 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:41:10.295764 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-f8a375c6-1e86-44d4-b912-9ceba2339591 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507" status: 200 len: 1321 microversion: 2.1 time: 0.299780 Aug 09 02:41:10.296310 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 36/83] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:09 2022] GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507 => generated 1321 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:11.021466 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-b78d7ddd-b139-409f-bc39-87ed921b0e7b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:11.022099 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-b78d7ddd-b139-409f-bc39-87ed921b0e7b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:11.030178 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b78d7ddd-b139-409f-bc39-87ed921b0e7b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:11.030907 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b78d7ddd-b139-409f-bc39-87ed921b0e7b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:11.031263 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b78d7ddd-b139-409f-bc39-87ed921b0e7b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:11.031915 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b78d7ddd-b139-409f-bc39-87ed921b0e7b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:11.032374 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b78d7ddd-b139-409f-bc39-87ed921b0e7b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:11.032913 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b78d7ddd-b139-409f-bc39-87ed921b0e7b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:11.203591 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-b78d7ddd-b139-409f-bc39-87ed921b0e7b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:11.214786 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-b78d7ddd-b139-409f-bc39-87ed921b0e7b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a" status: 200 len: 1367 microversion: 2.1 time: 0.197898 Aug 09 02:41:11.215823 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 48/84] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:11 2022] GET /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:11.313170 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-1b75f6c6-b48c-48d1-b8ce-d1ffc9ef40cd tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:11.314727 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-1b75f6c6-b48c-48d1-b8ce-d1ffc9ef40cd tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:11.319417 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-d177ca61-5531-4d3b-8884-0e932abbeaaf tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:11.320159 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-d177ca61-5531-4d3b-8884-0e932abbeaaf tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:11.326173 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1b75f6c6-b48c-48d1-b8ce-d1ffc9ef40cd tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:11.326811 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d177ca61-5531-4d3b-8884-0e932abbeaaf tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:11.327706 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d177ca61-5531-4d3b-8884-0e932abbeaaf tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:11.328619 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d177ca61-5531-4d3b-8884-0e932abbeaaf tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:11.328916 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1b75f6c6-b48c-48d1-b8ce-d1ffc9ef40cd tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:11.329523 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1b75f6c6-b48c-48d1-b8ce-d1ffc9ef40cd tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:11.329763 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d177ca61-5531-4d3b-8884-0e932abbeaaf tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:11.330274 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1b75f6c6-b48c-48d1-b8ce-d1ffc9ef40cd tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:11.331005 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1b75f6c6-b48c-48d1-b8ce-d1ffc9ef40cd tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:11.331088 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d177ca61-5531-4d3b-8884-0e932abbeaaf tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:11.331463 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d177ca61-5531-4d3b-8884-0e932abbeaaf tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:11.332113 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1b75f6c6-b48c-48d1-b8ce-d1ffc9ef40cd tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:11.662480 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-1b75f6c6-b48c-48d1-b8ce-d1ffc9ef40cd tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:11.671369 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-1b75f6c6-b48c-48d1-b8ce-d1ffc9ef40cd tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 200 len: 1362 microversion: 2.1 time: 0.362212 Aug 09 02:41:11.672619 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 37/85] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:11 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 1362 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:11.704921 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-d177ca61-5531-4d3b-8884-0e932abbeaaf tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:11.714844 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-d177ca61-5531-4d3b-8884-0e932abbeaaf tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507" status: 200 len: 1321 microversion: 2.1 time: 0.401672 Aug 09 02:41:11.715432 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 49/86] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:11 2022] GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507 => generated 1321 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:12.191072 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-7b6cf947-a969-4a1d-9c9f-b743d9a2ace5 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1533416d-c719-48bc-af8c-957bf70ce7ee"}} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:41:12.193799 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-7b6cf947-a969-4a1d-9c9f-b743d9a2ace5 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] [instance: 1e614721-c888-4eaf-b834-42497e80345c] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:12.210253 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7b6cf947-a969-4a1d-9c9f-b743d9a2ace5 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:12.210879 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7b6cf947-a969-4a1d-9c9f-b743d9a2ace5 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:12.211226 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7b6cf947-a969-4a1d-9c9f-b743d9a2ace5 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:12.212162 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7b6cf947-a969-4a1d-9c9f-b743d9a2ace5 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:12.212510 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7b6cf947-a969-4a1d-9c9f-b743d9a2ace5 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:12.212933 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7b6cf947-a969-4a1d-9c9f-b743d9a2ace5 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:12.240210 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-73b75c8a-2072-4101-92d1-9eb90865c75c tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:12.242269 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-73b75c8a-2072-4101-92d1-9eb90865c75c tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:12.258676 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-73b75c8a-2072-4101-92d1-9eb90865c75c tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:12.259500 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-73b75c8a-2072-4101-92d1-9eb90865c75c tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:12.260341 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-73b75c8a-2072-4101-92d1-9eb90865c75c tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:12.261433 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-73b75c8a-2072-4101-92d1-9eb90865c75c tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:12.262022 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-73b75c8a-2072-4101-92d1-9eb90865c75c tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:12.262488 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-73b75c8a-2072-4101-92d1-9eb90865c75c tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:12.497345 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-73b75c8a-2072-4101-92d1-9eb90865c75c tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:12.507242 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-73b75c8a-2072-4101-92d1-9eb90865c75c tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a" status: 200 len: 1367 microversion: 2.1 time: 0.274117 Aug 09 02:41:12.510623 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 50/87] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:12 2022] GET /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a => generated 1367 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:12.618267 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [req-fbf5eefc-d5b7-4924-9e46-f0700d473ba2 req-61c59b3f-ab3b-42d5-b4b4-56005e7244ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f16a110-9dc8-4e95-b6de-c30feee35b89", "tag": "e1bca63c-8e79-4219-8848-c50bf228ba03"}]} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:41:12.641469 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-fbf5eefc-d5b7-4924-9e46-f0700d473ba2 req-61c59b3f-ab3b-42d5-b4b4-56005e7244ae service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:12.641934 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-fbf5eefc-d5b7-4924-9e46-f0700d473ba2 req-61c59b3f-ab3b-42d5-b4b4-56005e7244ae service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:12.642385 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-fbf5eefc-d5b7-4924-9e46-f0700d473ba2 req-61c59b3f-ab3b-42d5-b4b4-56005e7244ae service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:12.683358 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.compute.server_external_events [req-fbf5eefc-d5b7-4924-9e46-f0700d473ba2 req-61c59b3f-ab3b-42d5-b4b4-56005e7244ae service nova] Creating event network-changed:e1bca63c-8e79-4219-8848-c50bf228ba03 for instance 8f16a110-9dc8-4e95-b6de-c30feee35b89 on hv-cinder-85246 Aug 09 02:41:12.691657 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [req-fbf5eefc-d5b7-4924-9e46-f0700d473ba2 req-61c59b3f-ab3b-42d5-b4b4-56005e7244ae service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081265 Aug 09 02:41:12.692803 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 51/88] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:41:12.708533 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-d88e9e8f-8471-41aa-a10e-aaf1d0d7d4b4 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:12.709340 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-d88e9e8f-8471-41aa-a10e-aaf1d0d7d4b4 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:12.716409 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d88e9e8f-8471-41aa-a10e-aaf1d0d7d4b4 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:12.717084 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d88e9e8f-8471-41aa-a10e-aaf1d0d7d4b4 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:12.717576 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d88e9e8f-8471-41aa-a10e-aaf1d0d7d4b4 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:12.718394 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d88e9e8f-8471-41aa-a10e-aaf1d0d7d4b4 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:12.718997 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d88e9e8f-8471-41aa-a10e-aaf1d0d7d4b4 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:12.719472 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d88e9e8f-8471-41aa-a10e-aaf1d0d7d4b4 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:12.998532 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-d88e9e8f-8471-41aa-a10e-aaf1d0d7d4b4 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:12.998904 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-7b6cf947-a969-4a1d-9c9f-b743d9a2ace5 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] 10.222.0.20 "POST /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.811708 Aug 09 02:41:13.000071 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 38/89] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Aug 9 02:41:12 2022] POST /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c/os-volume_attachments => generated 194 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:41:13.005817 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-856e519f-23ba-4fff-b73b-2386122c741a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:13.006803 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-856e519f-23ba-4fff-b73b-2386122c741a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:13.015270 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-d88e9e8f-8471-41aa-a10e-aaf1d0d7d4b4 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 200 len: 1362 microversion: 2.1 time: 0.320732 Aug 09 02:41:13.017867 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-856e519f-23ba-4fff-b73b-2386122c741a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:13.018611 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-856e519f-23ba-4fff-b73b-2386122c741a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:13.019325 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-856e519f-23ba-4fff-b73b-2386122c741a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:13.020029 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-856e519f-23ba-4fff-b73b-2386122c741a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:13.020675 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-856e519f-23ba-4fff-b73b-2386122c741a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:13.021181 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-856e519f-23ba-4fff-b73b-2386122c741a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:13.033010 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 52/90] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:12 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 1362 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:13.172972 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-856e519f-23ba-4fff-b73b-2386122c741a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:13.184565 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-856e519f-23ba-4fff-b73b-2386122c741a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507" status: 200 len: 1321 microversion: 2.1 time: 0.182986 Aug 09 02:41:13.185346 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 39/91] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:13 2022] GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507 => generated 1321 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:13.530852 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-697e4423-ed00-4c7d-8098-392fd7179d28 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:13.532062 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-697e4423-ed00-4c7d-8098-392fd7179d28 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:13.539314 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-697e4423-ed00-4c7d-8098-392fd7179d28 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:13.539880 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-697e4423-ed00-4c7d-8098-392fd7179d28 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:13.540375 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-697e4423-ed00-4c7d-8098-392fd7179d28 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:13.541214 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-697e4423-ed00-4c7d-8098-392fd7179d28 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:13.541810 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-697e4423-ed00-4c7d-8098-392fd7179d28 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:13.542599 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-697e4423-ed00-4c7d-8098-392fd7179d28 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:13.886117 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-697e4423-ed00-4c7d-8098-392fd7179d28 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:13.899697 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-697e4423-ed00-4c7d-8098-392fd7179d28 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a" status: 200 len: 1367 microversion: 2.1 time: 0.372602 Aug 09 02:41:13.902619 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 53/92] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:13 2022] GET /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a => generated 1367 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:14.038461 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-5a986807-f056-4f7c-b208-17e09e727504 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:14.040033 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-5a986807-f056-4f7c-b208-17e09e727504 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:14.050604 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-5a986807-f056-4f7c-b208-17e09e727504 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:14.051843 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-5a986807-f056-4f7c-b208-17e09e727504 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:14.052383 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-5a986807-f056-4f7c-b208-17e09e727504 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:14.053129 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-5a986807-f056-4f7c-b208-17e09e727504 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:14.053616 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-5a986807-f056-4f7c-b208-17e09e727504 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:14.054242 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-5a986807-f056-4f7c-b208-17e09e727504 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:14.207236 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-719449d1-876f-4c2b-b3b3-627f35dae567 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:14.207863 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-719449d1-876f-4c2b-b3b3-627f35dae567 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:14.231570 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-719449d1-876f-4c2b-b3b3-627f35dae567 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:14.232053 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-719449d1-876f-4c2b-b3b3-627f35dae567 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:14.232487 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-719449d1-876f-4c2b-b3b3-627f35dae567 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:14.233187 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-719449d1-876f-4c2b-b3b3-627f35dae567 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:14.238340 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-719449d1-876f-4c2b-b3b3-627f35dae567 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:14.239974 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-719449d1-876f-4c2b-b3b3-627f35dae567 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:14.750733 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-5a986807-f056-4f7c-b208-17e09e727504 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:14.759652 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-5a986807-f056-4f7c-b208-17e09e727504 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 200 len: 1362 microversion: 2.1 time: 0.725480 Aug 09 02:41:14.767588 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-719449d1-876f-4c2b-b3b3-627f35dae567 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:14.776204 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 40/93] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:14 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 1362 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:14.788918 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-719449d1-876f-4c2b-b3b3-627f35dae567 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507" status: 200 len: 1321 microversion: 2.1 time: 0.579364 Aug 09 02:41:14.788918 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 54/94] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:14 2022] GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507 => generated 1321 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:14.923222 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-f8cdc034-5682-439f-8a6f-ac2395d8cdaf tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:14.924037 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-f8cdc034-5682-439f-8a6f-ac2395d8cdaf tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:14.930164 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f8cdc034-5682-439f-8a6f-ac2395d8cdaf tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:14.930670 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f8cdc034-5682-439f-8a6f-ac2395d8cdaf tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:14.931098 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f8cdc034-5682-439f-8a6f-ac2395d8cdaf tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:14.931783 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f8cdc034-5682-439f-8a6f-ac2395d8cdaf tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:14.932223 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f8cdc034-5682-439f-8a6f-ac2395d8cdaf tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:14.932636 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f8cdc034-5682-439f-8a6f-ac2395d8cdaf tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:15.090035 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-f8cdc034-5682-439f-8a6f-ac2395d8cdaf tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:15.098311 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-f8cdc034-5682-439f-8a6f-ac2395d8cdaf tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a" status: 200 len: 1557 microversion: 2.1 time: 0.179297 Aug 09 02:41:15.098901 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 41/95] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:14 2022] GET /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a => generated 1557 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:15.120520 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-30683c74-c0a8-4e68-bd88-a7c38a469e1b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:15.121087 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-30683c74-c0a8-4e68-bd88-a7c38a469e1b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:15.127059 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-30683c74-c0a8-4e68-bd88-a7c38a469e1b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:15.127590 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-30683c74-c0a8-4e68-bd88-a7c38a469e1b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:15.128052 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-30683c74-c0a8-4e68-bd88-a7c38a469e1b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:15.128853 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-30683c74-c0a8-4e68-bd88-a7c38a469e1b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:15.129301 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-30683c74-c0a8-4e68-bd88-a7c38a469e1b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:15.129709 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-30683c74-c0a8-4e68-bd88-a7c38a469e1b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:15.246659 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-30683c74-c0a8-4e68-bd88-a7c38a469e1b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.130447 Aug 09 02:41:15.247284 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 55/96] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Aug 9 02:41:15 2022] GET /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a/os-interface => generated 284 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:41:15.784666 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-fc81c514-532f-425c-b950-6a15d0dfd94f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:15.785774 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-fc81c514-532f-425c-b950-6a15d0dfd94f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:15.794637 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-fc81c514-532f-425c-b950-6a15d0dfd94f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:15.795458 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-fc81c514-532f-425c-b950-6a15d0dfd94f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:15.796495 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-fc81c514-532f-425c-b950-6a15d0dfd94f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:15.797256 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-fc81c514-532f-425c-b950-6a15d0dfd94f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:15.798093 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-fc81c514-532f-425c-b950-6a15d0dfd94f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:15.799427 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-fc81c514-532f-425c-b950-6a15d0dfd94f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:15.807306 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-ba288d5f-14d0-40a4-b21c-beb4753d12a2 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:15.808038 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-ba288d5f-14d0-40a4-b21c-beb4753d12a2 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:15.815995 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ba288d5f-14d0-40a4-b21c-beb4753d12a2 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:15.816477 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ba288d5f-14d0-40a4-b21c-beb4753d12a2 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:15.816894 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ba288d5f-14d0-40a4-b21c-beb4753d12a2 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:15.817580 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ba288d5f-14d0-40a4-b21c-beb4753d12a2 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:15.818016 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ba288d5f-14d0-40a4-b21c-beb4753d12a2 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:15.818447 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ba288d5f-14d0-40a4-b21c-beb4753d12a2 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:16.192272 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-fc81c514-532f-425c-b950-6a15d0dfd94f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:16.197310 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-ba288d5f-14d0-40a4-b21c-beb4753d12a2 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:16.205479 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-ba288d5f-14d0-40a4-b21c-beb4753d12a2 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507" status: 200 len: 1321 microversion: 2.1 time: 0.404305 Aug 09 02:41:16.206296 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 56/97] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:15 2022] GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507 => generated 1321 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:41:16.233525 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-fc81c514-532f-425c-b950-6a15d0dfd94f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 200 len: 1362 microversion: 2.1 time: 0.454808 Aug 09 02:41:16.248905 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 42/98] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:15 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 1362 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:16.830943 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [req-27574e70-ce58-443d-84f9-dad68c91c08d req-7499c46e-51fe-45e8-8a69-16d37aca99d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a", "tag": "78354ed7-300a-4712-933c-8e98c2dff363"}]} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:41:16.840428 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-27574e70-ce58-443d-84f9-dad68c91c08d req-7499c46e-51fe-45e8-8a69-16d37aca99d0 service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:16.840898 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-27574e70-ce58-443d-84f9-dad68c91c08d req-7499c46e-51fe-45e8-8a69-16d37aca99d0 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:16.841322 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-27574e70-ce58-443d-84f9-dad68c91c08d req-7499c46e-51fe-45e8-8a69-16d37aca99d0 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:16.852044 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.compute.server_external_events [req-27574e70-ce58-443d-84f9-dad68c91c08d req-7499c46e-51fe-45e8-8a69-16d37aca99d0 service nova] Creating event network-changed:78354ed7-300a-4712-933c-8e98c2dff363 for instance e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a on hv-cinder-85246 Aug 09 02:41:16.857359 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [req-27574e70-ce58-443d-84f9-dad68c91c08d req-7499c46e-51fe-45e8-8a69-16d37aca99d0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030073 Aug 09 02:41:16.857942 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 57/99] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:41:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:41:17.229363 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-fa25cb30-7d96-440b-a3f7-1cc0524719c9 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:17.230637 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-fa25cb30-7d96-440b-a3f7-1cc0524719c9 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:17.237305 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-fa25cb30-7d96-440b-a3f7-1cc0524719c9 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:17.238103 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-fa25cb30-7d96-440b-a3f7-1cc0524719c9 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:17.238570 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-fa25cb30-7d96-440b-a3f7-1cc0524719c9 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:17.239237 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-fa25cb30-7d96-440b-a3f7-1cc0524719c9 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:17.239679 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-fa25cb30-7d96-440b-a3f7-1cc0524719c9 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:17.240086 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-fa25cb30-7d96-440b-a3f7-1cc0524719c9 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:17.256092 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-51ba355d-9137-46d8-92d0-08926fae1ab8 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:17.258065 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-51ba355d-9137-46d8-92d0-08926fae1ab8 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:17.266132 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-51ba355d-9137-46d8-92d0-08926fae1ab8 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:17.266983 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-51ba355d-9137-46d8-92d0-08926fae1ab8 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:17.267779 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-51ba355d-9137-46d8-92d0-08926fae1ab8 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:17.268832 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-51ba355d-9137-46d8-92d0-08926fae1ab8 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:17.269722 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-51ba355d-9137-46d8-92d0-08926fae1ab8 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:17.270362 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-51ba355d-9137-46d8-92d0-08926fae1ab8 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:17.441950 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-fa25cb30-7d96-440b-a3f7-1cc0524719c9 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:17.452812 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-fa25cb30-7d96-440b-a3f7-1cc0524719c9 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507" status: 200 len: 1321 microversion: 2.1 time: 0.227765 Aug 09 02:41:17.455829 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 43/100] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:17 2022] GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507 => generated 1321 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:17.465564 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-51ba355d-9137-46d8-92d0-08926fae1ab8 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:17.473168 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-51ba355d-9137-46d8-92d0-08926fae1ab8 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 200 len: 1362 microversion: 2.1 time: 0.221799 Aug 09 02:41:17.473727 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 58/101] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:17 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 1362 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:41:18.477359 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-a2958382-df8c-48c3-887b-7d6b3595e9fb tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:18.478272 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-a2958382-df8c-48c3-887b-7d6b3595e9fb tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:18.487072 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a2958382-df8c-48c3-887b-7d6b3595e9fb tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:18.487894 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a2958382-df8c-48c3-887b-7d6b3595e9fb tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:18.495026 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-92f1cb4d-b6c3-4b95-b33c-9cf35f2cbaeb tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:18.496797 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-92f1cb4d-b6c3-4b95-b33c-9cf35f2cbaeb tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:18.513025 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a2958382-df8c-48c3-887b-7d6b3595e9fb tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:18.516220 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a2958382-df8c-48c3-887b-7d6b3595e9fb tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:18.518355 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a2958382-df8c-48c3-887b-7d6b3595e9fb tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:18.520406 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-92f1cb4d-b6c3-4b95-b33c-9cf35f2cbaeb tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:18.520707 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a2958382-df8c-48c3-887b-7d6b3595e9fb tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:18.522210 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-92f1cb4d-b6c3-4b95-b33c-9cf35f2cbaeb tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:18.526059 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-92f1cb4d-b6c3-4b95-b33c-9cf35f2cbaeb tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:18.527187 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-92f1cb4d-b6c3-4b95-b33c-9cf35f2cbaeb tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:18.531112 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-92f1cb4d-b6c3-4b95-b33c-9cf35f2cbaeb tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:18.531847 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-92f1cb4d-b6c3-4b95-b33c-9cf35f2cbaeb tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:18.791735 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-92f1cb4d-b6c3-4b95-b33c-9cf35f2cbaeb tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:18.800161 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-92f1cb4d-b6c3-4b95-b33c-9cf35f2cbaeb tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 200 len: 1362 microversion: 2.1 time: 0.310098 Aug 09 02:41:18.800978 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 59/102] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:18 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 1362 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:18.819146 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-a2958382-df8c-48c3-887b-7d6b3595e9fb tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:18.827697 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-a2958382-df8c-48c3-887b-7d6b3595e9fb tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507" status: 200 len: 1321 microversion: 2.1 time: 0.356893 Aug 09 02:41:18.828333 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 44/103] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:18 2022] GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507 => generated 1321 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:19.820900 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-ceb2c06e-e6bb-4f94-aa2c-a041ffa0bbd0 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:19.821834 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-ceb2c06e-e6bb-4f94-aa2c-a041ffa0bbd0 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:19.828171 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ceb2c06e-e6bb-4f94-aa2c-a041ffa0bbd0 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:19.828673 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ceb2c06e-e6bb-4f94-aa2c-a041ffa0bbd0 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:19.829066 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ceb2c06e-e6bb-4f94-aa2c-a041ffa0bbd0 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:19.829978 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ceb2c06e-e6bb-4f94-aa2c-a041ffa0bbd0 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:19.830228 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ceb2c06e-e6bb-4f94-aa2c-a041ffa0bbd0 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:19.830642 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ceb2c06e-e6bb-4f94-aa2c-a041ffa0bbd0 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:19.848493 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-eb43e999-8bbc-4fed-877a-f86b672d6e46 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:19.849079 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-eb43e999-8bbc-4fed-877a-f86b672d6e46 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:19.856097 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-eb43e999-8bbc-4fed-877a-f86b672d6e46 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:19.856583 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-eb43e999-8bbc-4fed-877a-f86b672d6e46 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:19.857045 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-eb43e999-8bbc-4fed-877a-f86b672d6e46 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:19.857741 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-eb43e999-8bbc-4fed-877a-f86b672d6e46 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:19.858146 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-eb43e999-8bbc-4fed-877a-f86b672d6e46 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:19.858791 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-eb43e999-8bbc-4fed-877a-f86b672d6e46 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:20.033148 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-ceb2c06e-e6bb-4f94-aa2c-a041ffa0bbd0 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:20.035644 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_cell1:SELECT=100 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:41:20.036330 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-eb43e999-8bbc-4fed-877a-f86b672d6e46 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:20.042931 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-ceb2c06e-e6bb-4f94-aa2c-a041ffa0bbd0 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 200 len: 1362 microversion: 2.1 time: 0.225837 Aug 09 02:41:20.043511 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 60/104] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:19 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 1362 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:20.044933 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-eb43e999-8bbc-4fed-877a-f86b672d6e46 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507" status: 200 len: 1321 microversion: 2.1 time: 0.200400 Aug 09 02:41:20.045527 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 45/105] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:19 2022] GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507 => generated 1321 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:21.067396 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-a53a996a-d148-46be-8711-9144a446afc8 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:21.067936 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-a53a996a-d148-46be-8711-9144a446afc8 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:21.068344 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-79acab31-b386-44e9-94e3-bebc62e06f5a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:21.068961 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-79acab31-b386-44e9-94e3-bebc62e06f5a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:21.074553 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a53a996a-d148-46be-8711-9144a446afc8 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:21.074915 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a53a996a-d148-46be-8711-9144a446afc8 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:21.075340 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a53a996a-d148-46be-8711-9144a446afc8 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:21.075744 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-79acab31-b386-44e9-94e3-bebc62e06f5a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:21.076057 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a53a996a-d148-46be-8711-9144a446afc8 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:21.076192 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-79acab31-b386-44e9-94e3-bebc62e06f5a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:21.076503 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a53a996a-d148-46be-8711-9144a446afc8 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:21.076637 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-79acab31-b386-44e9-94e3-bebc62e06f5a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:21.076921 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a53a996a-d148-46be-8711-9144a446afc8 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:21.077301 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-79acab31-b386-44e9-94e3-bebc62e06f5a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:21.077747 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-79acab31-b386-44e9-94e3-bebc62e06f5a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:21.078185 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-79acab31-b386-44e9-94e3-bebc62e06f5a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:21.269610 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-a53a996a-d148-46be-8711-9144a446afc8 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:21.272827 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-79acab31-b386-44e9-94e3-bebc62e06f5a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:21.277283 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-a53a996a-d148-46be-8711-9144a446afc8 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 200 len: 1362 microversion: 2.1 time: 0.216331 Aug 09 02:41:21.277934 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 61/106] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:21 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 1362 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:21.280571 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-79acab31-b386-44e9-94e3-bebc62e06f5a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507" status: 200 len: 1321 microversion: 2.1 time: 0.217563 Aug 09 02:41:21.281136 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 46/107] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:21 2022] GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507 => generated 1321 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:22.300778 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-ed781611-efbb-40c6-974b-83445f41a4f2 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:22.301645 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-ed781611-efbb-40c6-974b-83445f41a4f2 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:22.304735 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-a95fad76-19df-47b6-be6c-2f2e88bdd2b3 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:22.306001 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-a95fad76-19df-47b6-be6c-2f2e88bdd2b3 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:22.309885 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ed781611-efbb-40c6-974b-83445f41a4f2 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:22.310619 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ed781611-efbb-40c6-974b-83445f41a4f2 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:22.311391 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ed781611-efbb-40c6-974b-83445f41a4f2 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:22.312082 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a95fad76-19df-47b6-be6c-2f2e88bdd2b3 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:22.312630 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ed781611-efbb-40c6-974b-83445f41a4f2 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:22.313031 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a95fad76-19df-47b6-be6c-2f2e88bdd2b3 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:22.313171 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ed781611-efbb-40c6-974b-83445f41a4f2 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:22.313502 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a95fad76-19df-47b6-be6c-2f2e88bdd2b3 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:22.313628 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ed781611-efbb-40c6-974b-83445f41a4f2 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:22.314218 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a95fad76-19df-47b6-be6c-2f2e88bdd2b3 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:22.314974 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a95fad76-19df-47b6-be6c-2f2e88bdd2b3 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:22.315727 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a95fad76-19df-47b6-be6c-2f2e88bdd2b3 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:22.670860 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-a95fad76-19df-47b6-be6c-2f2e88bdd2b3 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:22.688590 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-a95fad76-19df-47b6-be6c-2f2e88bdd2b3 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 200 len: 1362 microversion: 2.1 time: 0.392222 Aug 09 02:41:22.690451 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 62/108] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:22 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 1362 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:22.715044 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-ed781611-efbb-40c6-974b-83445f41a4f2 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:22.724975 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-ed781611-efbb-40c6-974b-83445f41a4f2 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507" status: 200 len: 1321 microversion: 2.1 time: 0.428040 Aug 09 02:41:22.754578 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 47/109] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:22 2022] GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507 => generated 1321 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:23.059382 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-7b27e899-ae8b-4c1a-9279-810d93a8ffe6 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-75597942", "imageRef": "04a06944-b2a8-4a65-b2a6-7ed3ff18a627", "flavorRef": "452"}} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:41:23.112014 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.network.neutron [None req-7b27e899-ae8b-4c1a-9279-810d93a8ffe6 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] validate_networks() for None {{(pid=124427) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 02:41:23.384374 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.virt.hardware [None req-7b27e899-ae8b-4c1a-9279-810d93a8ffe6 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Flavor limits 0:0:0 {{(pid=124427) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 02:41:23.384998 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.virt.hardware [None req-7b27e899-ae8b-4c1a-9279-810d93a8ffe6 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Image limits 0:0:0 {{(pid=124427) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 02:41:23.385244 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.virt.hardware [None req-7b27e899-ae8b-4c1a-9279-810d93a8ffe6 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Flavor pref 0:0:0 {{(pid=124427) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 02:41:23.386027 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.virt.hardware [None req-7b27e899-ae8b-4c1a-9279-810d93a8ffe6 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Image pref 0:0:0 {{(pid=124427) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 02:41:23.386459 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.virt.hardware [None req-7b27e899-ae8b-4c1a-9279-810d93a8ffe6 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124427) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 02:41:23.388482 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:41:23.397267 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7b27e899-ae8b-4c1a-9279-810d93a8ffe6 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:23.397739 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7b27e899-ae8b-4c1a-9279-810d93a8ffe6 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:23.398195 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7b27e899-ae8b-4c1a-9279-810d93a8ffe6 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:23.399335 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7b27e899-ae8b-4c1a-9279-810d93a8ffe6 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:23.399730 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7b27e899-ae8b-4c1a-9279-810d93a8ffe6 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:23.400148 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7b27e899-ae8b-4c1a-9279-810d93a8ffe6 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:23.418677 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.quota [None req-7b27e899-ae8b-4c1a-9279-810d93a8ffe6 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Getting quotas for project 017a524b579e48d2bc6fe99ab8332456. Resources: {'cores', 'ram', 'instances'} {{(pid=124427) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 02:41:23.422867 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.quota [None req-7b27e899-ae8b-4c1a-9279-810d93a8ffe6 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Getting quotas for user 33f584ae6eae48e994c19ae3786b95d4 and project 017a524b579e48d2bc6fe99ab8332456. Resources: {'cores', 'ram', 'instances'} {{(pid=124427) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 02:41:23.434564 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-7b27e899-ae8b-4c1a-9279-810d93a8ffe6 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Going to run 1 instances... {{(pid=124427) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 02:41:23.436865 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-7b27e899-ae8b-4c1a-9279-810d93a8ffe6 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] [instance: 49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='04a06944-b2a8-4a65-b2a6-7ed3ff18a627',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124427) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 02:41:23.482777 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-7b27e899-ae8b-4c1a-9279-810d93a8ffe6 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.427176 Aug 09 02:41:23.483676 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 63/110] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Aug 9 02:41:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 429 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 02:41:23.494585 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-0af8b569-7dde-4e9a-b083-c967bef28710 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:23.495908 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-0af8b569-7dde-4e9a-b083-c967bef28710 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] [instance: 49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:23.549233 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-0af8b569-7dde-4e9a-b083-c967bef28710 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f584ae6eae48e994c19ae3786b95d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017a524b579e48d2bc6fe99ab8332456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:23.557638 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-0af8b569-7dde-4e9a-b083-c967bef28710 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] 10.222.0.20 "GET /compute/v2.1/servers/49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e" status: 200 len: 1213 microversion: 2.1 time: 0.067019 Aug 09 02:41:23.558265 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 48/111] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:23 2022] GET /compute/v2.1/servers/49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e => generated 1213 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:23.620797 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [req-b8c24bc5-45d8-4182-bbad-b769da9db466 req-f6dbf014-5f85-4e37-9953-a235455f6985 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f16a110-9dc8-4e95-b6de-c30feee35b89", "name": "network-vif-plugged", "status": "completed", "tag": "e1bca63c-8e79-4219-8848-c50bf228ba03"}]} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:41:23.630929 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-b8c24bc5-45d8-4182-bbad-b769da9db466 req-f6dbf014-5f85-4e37-9953-a235455f6985 service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:23.631506 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-b8c24bc5-45d8-4182-bbad-b769da9db466 req-f6dbf014-5f85-4e37-9953-a235455f6985 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:23.632122 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-b8c24bc5-45d8-4182-bbad-b769da9db466 req-f6dbf014-5f85-4e37-9953-a235455f6985 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:23.644533 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.compute.server_external_events [req-b8c24bc5-45d8-4182-bbad-b769da9db466 req-f6dbf014-5f85-4e37-9953-a235455f6985 service nova] Creating event network-vif-plugged:e1bca63c-8e79-4219-8848-c50bf228ba03 for instance 8f16a110-9dc8-4e95-b6de-c30feee35b89 on hv-cinder-85246 Aug 09 02:41:23.650857 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [req-b8c24bc5-45d8-4182-bbad-b769da9db466 req-f6dbf014-5f85-4e37-9953-a235455f6985 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033965 Aug 09 02:41:23.651386 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 64/112] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:41:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:41:23.713447 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-85725ae8-1d03-48b8-bb1a-2ec9ce50f6f1 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:23.714320 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-85725ae8-1d03-48b8-bb1a-2ec9ce50f6f1 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:23.721336 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-85725ae8-1d03-48b8-bb1a-2ec9ce50f6f1 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:23.722117 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-85725ae8-1d03-48b8-bb1a-2ec9ce50f6f1 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:23.722567 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-85725ae8-1d03-48b8-bb1a-2ec9ce50f6f1 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:23.723453 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-85725ae8-1d03-48b8-bb1a-2ec9ce50f6f1 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:23.723878 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-85725ae8-1d03-48b8-bb1a-2ec9ce50f6f1 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:23.724460 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-85725ae8-1d03-48b8-bb1a-2ec9ce50f6f1 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:23.763005 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-71d9a2d1-ab64-49d2-9886-3f828fe8f672 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:23.764023 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-71d9a2d1-ab64-49d2-9886-3f828fe8f672 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:23.771155 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-71d9a2d1-ab64-49d2-9886-3f828fe8f672 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:23.772757 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-71d9a2d1-ab64-49d2-9886-3f828fe8f672 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:23.774041 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-71d9a2d1-ab64-49d2-9886-3f828fe8f672 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:23.774964 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-71d9a2d1-ab64-49d2-9886-3f828fe8f672 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:23.775726 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-71d9a2d1-ab64-49d2-9886-3f828fe8f672 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:23.776430 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-71d9a2d1-ab64-49d2-9886-3f828fe8f672 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:23.934579 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-85725ae8-1d03-48b8-bb1a-2ec9ce50f6f1 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:23.941335 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-85725ae8-1d03-48b8-bb1a-2ec9ce50f6f1 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 200 len: 1362 microversion: 2.1 time: 0.232376 Aug 09 02:41:23.956082 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 49/113] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:23 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 1362 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:23.962452 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-71d9a2d1-ab64-49d2-9886-3f828fe8f672 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:23.971423 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-71d9a2d1-ab64-49d2-9886-3f828fe8f672 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507" status: 200 len: 1321 microversion: 2.1 time: 0.212967 Aug 09 02:41:23.974213 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 65/114] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:23 2022] GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507 => generated 1321 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:41:24.582635 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-376ca000-6b0b-4026-a88e-2e6bf88817c0 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:24.583624 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-376ca000-6b0b-4026-a88e-2e6bf88817c0 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] [instance: 49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:24.594839 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-376ca000-6b0b-4026-a88e-2e6bf88817c0 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:24.595625 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-376ca000-6b0b-4026-a88e-2e6bf88817c0 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:24.596336 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-376ca000-6b0b-4026-a88e-2e6bf88817c0 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:24.597457 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-376ca000-6b0b-4026-a88e-2e6bf88817c0 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:24.598202 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-376ca000-6b0b-4026-a88e-2e6bf88817c0 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:24.598931 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-376ca000-6b0b-4026-a88e-2e6bf88817c0 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:24.662114 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-376ca000-6b0b-4026-a88e-2e6bf88817c0 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f584ae6eae48e994c19ae3786b95d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017a524b579e48d2bc6fe99ab8332456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:24.669959 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-376ca000-6b0b-4026-a88e-2e6bf88817c0 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] 10.222.0.20 "GET /compute/v2.1/servers/49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e" status: 200 len: 1217 microversion: 2.1 time: 0.093825 Aug 09 02:41:24.670492 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 50/115] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:24 2022] GET /compute/v2.1/servers/49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e => generated 1217 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:24.964244 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-7ce7cf1d-b2be-41fe-8880-f7ecb0d55efa tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:24.964809 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-7ce7cf1d-b2be-41fe-8880-f7ecb0d55efa tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:24.970997 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7ce7cf1d-b2be-41fe-8880-f7ecb0d55efa tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:24.971498 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7ce7cf1d-b2be-41fe-8880-f7ecb0d55efa tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:24.971917 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7ce7cf1d-b2be-41fe-8880-f7ecb0d55efa tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:24.972593 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7ce7cf1d-b2be-41fe-8880-f7ecb0d55efa tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:24.973041 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7ce7cf1d-b2be-41fe-8880-f7ecb0d55efa tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:24.973440 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7ce7cf1d-b2be-41fe-8880-f7ecb0d55efa tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:24.998834 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-915573b3-5e13-4f6a-b7e3-f03418fdd350 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:24.998834 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-915573b3-5e13-4f6a-b7e3-f03418fdd350 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:25.000316 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-915573b3-5e13-4f6a-b7e3-f03418fdd350 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:25.000316 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-915573b3-5e13-4f6a-b7e3-f03418fdd350 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:25.000616 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-915573b3-5e13-4f6a-b7e3-f03418fdd350 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:25.001308 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-915573b3-5e13-4f6a-b7e3-f03418fdd350 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:25.001744 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-915573b3-5e13-4f6a-b7e3-f03418fdd350 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:25.002243 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-915573b3-5e13-4f6a-b7e3-f03418fdd350 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:25.174305 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-7ce7cf1d-b2be-41fe-8880-f7ecb0d55efa tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:25.180845 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-915573b3-5e13-4f6a-b7e3-f03418fdd350 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:25.182317 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-7ce7cf1d-b2be-41fe-8880-f7ecb0d55efa tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 200 len: 1362 microversion: 2.1 time: 0.221969 Aug 09 02:41:25.182898 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 66/116] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:24 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 1362 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:25.188404 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-915573b3-5e13-4f6a-b7e3-f03418fdd350 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507" status: 200 len: 1321 microversion: 2.1 time: 0.199248 Aug 09 02:41:25.188969 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 51/117] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:24 2022] GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507 => generated 1321 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:25.675114 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [req-909321e9-53e6-45cf-94db-6b7b61ec3cf5 req-cbf423ce-c636-4256-8d20-1088d3be2906 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a587f99c-5ad7-4fa2-945e-06954d45d44d", "name": "network-vif-plugged", "status": "completed", "tag": "6db685d1-484e-4847-8638-637842940e30"}]} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:41:25.686269 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-909321e9-53e6-45cf-94db-6b7b61ec3cf5 req-cbf423ce-c636-4256-8d20-1088d3be2906 service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:25.686765 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-909321e9-53e6-45cf-94db-6b7b61ec3cf5 req-cbf423ce-c636-4256-8d20-1088d3be2906 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:25.687181 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-909321e9-53e6-45cf-94db-6b7b61ec3cf5 req-cbf423ce-c636-4256-8d20-1088d3be2906 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:25.690498 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-7049ec75-f920-4761-8d51-8da225be6ec2 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:25.691105 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-7049ec75-f920-4761-8d51-8da225be6ec2 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] [instance: 49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:25.697758 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7049ec75-f920-4761-8d51-8da225be6ec2 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:25.698265 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7049ec75-f920-4761-8d51-8da225be6ec2 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:25.698722 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.compute.server_external_events [req-909321e9-53e6-45cf-94db-6b7b61ec3cf5 req-cbf423ce-c636-4256-8d20-1088d3be2906 service nova] Creating event network-vif-plugged:6db685d1-484e-4847-8638-637842940e30 for instance a587f99c-5ad7-4fa2-945e-06954d45d44d on hv-cinder-85246 Aug 09 02:41:25.698887 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7049ec75-f920-4761-8d51-8da225be6ec2 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:25.699423 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7049ec75-f920-4761-8d51-8da225be6ec2 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:25.699853 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7049ec75-f920-4761-8d51-8da225be6ec2 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:25.700269 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7049ec75-f920-4761-8d51-8da225be6ec2 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:25.703546 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [req-909321e9-53e6-45cf-94db-6b7b61ec3cf5 req-cbf423ce-c636-4256-8d20-1088d3be2906 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034831 Aug 09 02:41:25.705516 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 67/118] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:41:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:41:25.766915 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-7049ec75-f920-4761-8d51-8da225be6ec2 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f584ae6eae48e994c19ae3786b95d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017a524b579e48d2bc6fe99ab8332456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:25.774401 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-7049ec75-f920-4761-8d51-8da225be6ec2 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] 10.222.0.20 "GET /compute/v2.1/servers/49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e" status: 200 len: 1217 microversion: 2.1 time: 0.087656 Aug 09 02:41:25.774972 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 52/119] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:25 2022] GET /compute/v2.1/servers/49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:26.204686 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-4bb058f9-2afb-4b36-bd61-5952059eb611 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:26.205839 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-4bb058f9-2afb-4b36-bd61-5952059eb611 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:26.208946 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-c17df64c-2350-435c-9830-c9aa1c87b2df tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:26.209592 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-c17df64c-2350-435c-9830-c9aa1c87b2df tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:26.212610 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4bb058f9-2afb-4b36-bd61-5952059eb611 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:26.213180 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4bb058f9-2afb-4b36-bd61-5952059eb611 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:26.213705 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4bb058f9-2afb-4b36-bd61-5952059eb611 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:26.215283 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4bb058f9-2afb-4b36-bd61-5952059eb611 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:26.215283 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4bb058f9-2afb-4b36-bd61-5952059eb611 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:26.215472 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4bb058f9-2afb-4b36-bd61-5952059eb611 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:26.215691 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c17df64c-2350-435c-9830-c9aa1c87b2df tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:26.216173 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c17df64c-2350-435c-9830-c9aa1c87b2df tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:26.216628 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c17df64c-2350-435c-9830-c9aa1c87b2df tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:26.217350 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c17df64c-2350-435c-9830-c9aa1c87b2df tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:26.217829 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c17df64c-2350-435c-9830-c9aa1c87b2df tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:26.218232 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c17df64c-2350-435c-9830-c9aa1c87b2df tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:26.234131 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:41:26.426334 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-c17df64c-2350-435c-9830-c9aa1c87b2df tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:26.439393 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-4bb058f9-2afb-4b36-bd61-5952059eb611 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:26.439599 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-c17df64c-2350-435c-9830-c9aa1c87b2df tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507" status: 200 len: 1321 microversion: 2.1 time: 0.234477 Aug 09 02:41:26.441671 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 53/120] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:26 2022] GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507 => generated 1321 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:26.461483 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-4bb058f9-2afb-4b36-bd61-5952059eb611 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 200 len: 1362 microversion: 2.1 time: 0.261496 Aug 09 02:41:26.463483 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 68/121] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:26 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 1362 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:26.798332 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-4afcedb6-9f08-44c9-b873-4f5083bf793e tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:26.799091 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-4afcedb6-9f08-44c9-b873-4f5083bf793e tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] [instance: 49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:26.808200 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4afcedb6-9f08-44c9-b873-4f5083bf793e tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:26.808918 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4afcedb6-9f08-44c9-b873-4f5083bf793e tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:26.809540 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4afcedb6-9f08-44c9-b873-4f5083bf793e tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:26.810640 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4afcedb6-9f08-44c9-b873-4f5083bf793e tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:26.811264 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4afcedb6-9f08-44c9-b873-4f5083bf793e tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:26.811876 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4afcedb6-9f08-44c9-b873-4f5083bf793e tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:26.876503 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-4afcedb6-9f08-44c9-b873-4f5083bf793e tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f584ae6eae48e994c19ae3786b95d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017a524b579e48d2bc6fe99ab8332456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:26.884429 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-4afcedb6-9f08-44c9-b873-4f5083bf793e tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] 10.222.0.20 "GET /compute/v2.1/servers/49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e" status: 200 len: 1265 microversion: 2.1 time: 0.091938 Aug 09 02:41:26.885003 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 54/122] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:26 2022] GET /compute/v2.1/servers/49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e => generated 1265 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:27.465530 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-daa12faa-3b2e-42c6-ba3b-be51e15b8a43 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:27.467014 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-daa12faa-3b2e-42c6-ba3b-be51e15b8a43 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:27.474133 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-daa12faa-3b2e-42c6-ba3b-be51e15b8a43 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:27.474589 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-daa12faa-3b2e-42c6-ba3b-be51e15b8a43 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:27.475014 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-daa12faa-3b2e-42c6-ba3b-be51e15b8a43 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:27.475708 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-daa12faa-3b2e-42c6-ba3b-be51e15b8a43 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:27.476752 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-daa12faa-3b2e-42c6-ba3b-be51e15b8a43 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:27.477448 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-daa12faa-3b2e-42c6-ba3b-be51e15b8a43 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:27.482242 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-8bdbeabc-80a7-4613-9e7b-0c1aabdffb3c tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:27.482850 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-8bdbeabc-80a7-4613-9e7b-0c1aabdffb3c tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:27.491084 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8bdbeabc-80a7-4613-9e7b-0c1aabdffb3c tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:27.491567 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8bdbeabc-80a7-4613-9e7b-0c1aabdffb3c tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:27.491994 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8bdbeabc-80a7-4613-9e7b-0c1aabdffb3c tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:27.492679 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8bdbeabc-80a7-4613-9e7b-0c1aabdffb3c tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:27.493208 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8bdbeabc-80a7-4613-9e7b-0c1aabdffb3c tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:27.493626 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8bdbeabc-80a7-4613-9e7b-0c1aabdffb3c tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:27.949005 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-daa12faa-3b2e-42c6-ba3b-be51e15b8a43 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:27.954642 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-8bdbeabc-80a7-4613-9e7b-0c1aabdffb3c tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:27.959029 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-daa12faa-3b2e-42c6-ba3b-be51e15b8a43 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507" status: 200 len: 1321 microversion: 2.1 time: 0.497480 Aug 09 02:41:27.959611 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 69/123] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:27 2022] GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507 => generated 1321 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:27.964252 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-8df9e21e-2260-4ff4-bd03-2fd2152e49ea tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:27.965061 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-8df9e21e-2260-4ff4-bd03-2fd2152e49ea tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] [instance: 49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:27.970887 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8df9e21e-2260-4ff4-bd03-2fd2152e49ea tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:27.971358 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8df9e21e-2260-4ff4-bd03-2fd2152e49ea tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:27.971948 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8df9e21e-2260-4ff4-bd03-2fd2152e49ea tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:27.972628 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8df9e21e-2260-4ff4-bd03-2fd2152e49ea tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:27.973081 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8df9e21e-2260-4ff4-bd03-2fd2152e49ea tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:27.973471 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8df9e21e-2260-4ff4-bd03-2fd2152e49ea tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:27.977178 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-8bdbeabc-80a7-4613-9e7b-0c1aabdffb3c tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 200 len: 1362 microversion: 2.1 time: 0.499079 Aug 09 02:41:27.991310 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 55/124] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:27 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 1362 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:28.062891 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-8df9e21e-2260-4ff4-bd03-2fd2152e49ea tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f584ae6eae48e994c19ae3786b95d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017a524b579e48d2bc6fe99ab8332456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:28.071848 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-8df9e21e-2260-4ff4-bd03-2fd2152e49ea tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] 10.222.0.20 "GET /compute/v2.1/servers/49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e" status: 200 len: 1265 microversion: 2.1 time: 0.111165 Aug 09 02:41:28.072372 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 70/125] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:27 2022] GET /compute/v2.1/servers/49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e => generated 1265 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:28.415681 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [req-8289ed6e-076f-46f0-8046-e65f36364981 req-8adc2df8-272f-4a56-886e-720788fa5a46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4571cba1-e225-40c3-aa20-12c3802c6507", "name": "network-vif-plugged", "status": "completed", "tag": "8f9897d0-4b5a-4a41-9c95-c0710478bbe7"}]} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:41:28.420984 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:41:28.428582 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-8289ed6e-076f-46f0-8046-e65f36364981 req-8adc2df8-272f-4a56-886e-720788fa5a46 service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:28.429594 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-8289ed6e-076f-46f0-8046-e65f36364981 req-8adc2df8-272f-4a56-886e-720788fa5a46 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:28.430616 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-8289ed6e-076f-46f0-8046-e65f36364981 req-8adc2df8-272f-4a56-886e-720788fa5a46 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:28.449035 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.compute.server_external_events [req-8289ed6e-076f-46f0-8046-e65f36364981 req-8adc2df8-272f-4a56-886e-720788fa5a46 service nova] Creating event network-vif-plugged:8f9897d0-4b5a-4a41-9c95-c0710478bbe7 for instance 4571cba1-e225-40c3-aa20-12c3802c6507 on hv-cinder-85246 Aug 09 02:41:28.466987 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [req-8289ed6e-076f-46f0-8046-e65f36364981 req-8adc2df8-272f-4a56-886e-720788fa5a46 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052962 Aug 09 02:41:28.467675 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 56/126] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:41:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:41:28.984411 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-1c3c9b5a-e401-4307-a646-7431553d7667 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:28.985240 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-1c3c9b5a-e401-4307-a646-7431553d7667 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:28.997448 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1c3c9b5a-e401-4307-a646-7431553d7667 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:28.997922 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1c3c9b5a-e401-4307-a646-7431553d7667 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:28.999455 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1c3c9b5a-e401-4307-a646-7431553d7667 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:29.001854 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-ea992c63-5b9a-47b0-930a-764152537daa tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:29.002470 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1c3c9b5a-e401-4307-a646-7431553d7667 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:29.002880 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-ea992c63-5b9a-47b0-930a-764152537daa tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:29.003395 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1c3c9b5a-e401-4307-a646-7431553d7667 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:29.003862 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1c3c9b5a-e401-4307-a646-7431553d7667 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:29.011171 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ea992c63-5b9a-47b0-930a-764152537daa tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:29.011896 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ea992c63-5b9a-47b0-930a-764152537daa tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:29.012520 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ea992c63-5b9a-47b0-930a-764152537daa tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:29.013400 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ea992c63-5b9a-47b0-930a-764152537daa tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:29.014070 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ea992c63-5b9a-47b0-930a-764152537daa tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:29.014814 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ea992c63-5b9a-47b0-930a-764152537daa tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:29.226430 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-ea992c63-5b9a-47b0-930a-764152537daa tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:29.239828 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-ea992c63-5b9a-47b0-930a-764152537daa tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 200 len: 1362 microversion: 2.1 time: 0.243742 Aug 09 02:41:29.240431 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 57/127] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:28 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 1362 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:41:29.244993 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-1c97c63b-541c-44a2-a0d4-08ed4b141bb3 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:29.245602 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-1c97c63b-541c-44a2-a0d4-08ed4b141bb3 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] [instance: 49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:29.257941 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1c97c63b-541c-44a2-a0d4-08ed4b141bb3 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:29.258446 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1c97c63b-541c-44a2-a0d4-08ed4b141bb3 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:29.258975 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1c97c63b-541c-44a2-a0d4-08ed4b141bb3 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:29.259669 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1c97c63b-541c-44a2-a0d4-08ed4b141bb3 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:29.260114 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1c97c63b-541c-44a2-a0d4-08ed4b141bb3 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:29.260522 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1c97c63b-541c-44a2-a0d4-08ed4b141bb3 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:29.272634 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-1c3c9b5a-e401-4307-a646-7431553d7667 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:29.282778 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-1c3c9b5a-e401-4307-a646-7431553d7667 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507" status: 200 len: 1321 microversion: 2.1 time: 0.303681 Aug 09 02:41:29.283728 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 71/128] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:28 2022] GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507 => generated 1321 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:29.349169 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-1c97c63b-541c-44a2-a0d4-08ed4b141bb3 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f584ae6eae48e994c19ae3786b95d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017a524b579e48d2bc6fe99ab8332456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:29.370648 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-1c97c63b-541c-44a2-a0d4-08ed4b141bb3 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] 10.222.0.20 "GET /compute/v2.1/servers/49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e" status: 200 len: 1273 microversion: 2.1 time: 0.129079 Aug 09 02:41:29.371604 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 58/129] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:29 2022] GET /compute/v2.1/servers/49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e => generated 1273 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:30.260697 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-f132c726-1069-4e88-abba-00c0316ca306 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:30.261512 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-f132c726-1069-4e88-abba-00c0316ca306 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:30.268328 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-f132c726-1069-4e88-abba-00c0316ca306 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:30.269141 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-f132c726-1069-4e88-abba-00c0316ca306 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:30.269810 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-f132c726-1069-4e88-abba-00c0316ca306 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:30.270855 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-f132c726-1069-4e88-abba-00c0316ca306 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:30.271436 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-f132c726-1069-4e88-abba-00c0316ca306 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:30.271979 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-f132c726-1069-4e88-abba-00c0316ca306 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:30.309435 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-938d472b-c18a-4385-beaa-88c0b4cd4b90 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:30.310699 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-938d472b-c18a-4385-beaa-88c0b4cd4b90 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:30.319453 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-938d472b-c18a-4385-beaa-88c0b4cd4b90 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:30.320024 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-938d472b-c18a-4385-beaa-88c0b4cd4b90 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:30.320510 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-938d472b-c18a-4385-beaa-88c0b4cd4b90 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:30.321722 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-938d472b-c18a-4385-beaa-88c0b4cd4b90 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:30.322271 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-938d472b-c18a-4385-beaa-88c0b4cd4b90 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:30.322889 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-938d472b-c18a-4385-beaa-88c0b4cd4b90 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:30.478680 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-f132c726-1069-4e88-abba-00c0316ca306 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:30.498513 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-f132c726-1069-4e88-abba-00c0316ca306 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 200 len: 1547 microversion: 2.1 time: 0.239683 Aug 09 02:41:30.499506 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 72/130] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:30 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 1547 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:30.506681 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-e1df73a0-0de9-45c3-ab54-ee07148f2661 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:30.507538 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-e1df73a0-0de9-45c3-ab54-ee07148f2661 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] [instance: 49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:30.514862 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e1df73a0-0de9-45c3-ab54-ee07148f2661 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:30.515698 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e1df73a0-0de9-45c3-ab54-ee07148f2661 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:30.516279 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e1df73a0-0de9-45c3-ab54-ee07148f2661 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:30.516969 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e1df73a0-0de9-45c3-ab54-ee07148f2661 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:30.517410 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e1df73a0-0de9-45c3-ab54-ee07148f2661 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:30.517822 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e1df73a0-0de9-45c3-ab54-ee07148f2661 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:30.518581 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-938d472b-c18a-4385-beaa-88c0b4cd4b90 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:30.526557 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-938d472b-c18a-4385-beaa-88c0b4cd4b90 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507" status: 200 len: 1321 microversion: 2.1 time: 0.222434 Aug 09 02:41:30.527136 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 59/131] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:30 2022] GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507 => generated 1321 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:41:30.532413 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-518f1e2a-bc57-4088-8b43-1866e49d0094 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:30.533669 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-518f1e2a-bc57-4088-8b43-1866e49d0094 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:30.539907 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-518f1e2a-bc57-4088-8b43-1866e49d0094 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:30.540645 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-518f1e2a-bc57-4088-8b43-1866e49d0094 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:30.541081 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-518f1e2a-bc57-4088-8b43-1866e49d0094 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:30.541743 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-518f1e2a-bc57-4088-8b43-1866e49d0094 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:30.542329 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-518f1e2a-bc57-4088-8b43-1866e49d0094 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:30.542966 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-518f1e2a-bc57-4088-8b43-1866e49d0094 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:30.606082 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-e1df73a0-0de9-45c3-ab54-ee07148f2661 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f584ae6eae48e994c19ae3786b95d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017a524b579e48d2bc6fe99ab8332456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:30.614389 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-e1df73a0-0de9-45c3-ab54-ee07148f2661 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] 10.222.0.20 "GET /compute/v2.1/servers/49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e" status: 200 len: 1283 microversion: 2.1 time: 0.113314 Aug 09 02:41:30.615271 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 73/132] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:30 2022] GET /compute/v2.1/servers/49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e => generated 1283 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:30.653387 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-518f1e2a-bc57-4088-8b43-1866e49d0094 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.124866 Aug 09 02:41:30.654116 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 60/133] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Aug 9 02:41:30 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89/os-interface => generated 284 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:41:31.547762 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-7cc25f26-0c02-4a78-bc08-d1199a49691a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:31.548446 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-7cc25f26-0c02-4a78-bc08-d1199a49691a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:31.557357 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7cc25f26-0c02-4a78-bc08-d1199a49691a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:31.557912 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7cc25f26-0c02-4a78-bc08-d1199a49691a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:31.560603 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7cc25f26-0c02-4a78-bc08-d1199a49691a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:31.561380 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7cc25f26-0c02-4a78-bc08-d1199a49691a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:31.562006 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7cc25f26-0c02-4a78-bc08-d1199a49691a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:31.562609 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7cc25f26-0c02-4a78-bc08-d1199a49691a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:31.637376 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-2bc518ce-d455-4d9a-811c-37d9f079ee50 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:31.638045 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-2bc518ce-d455-4d9a-811c-37d9f079ee50 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] [instance: 49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:31.644333 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2bc518ce-d455-4d9a-811c-37d9f079ee50 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:31.644931 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2bc518ce-d455-4d9a-811c-37d9f079ee50 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:31.650725 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2bc518ce-d455-4d9a-811c-37d9f079ee50 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:31.652670 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2bc518ce-d455-4d9a-811c-37d9f079ee50 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:31.653603 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2bc518ce-d455-4d9a-811c-37d9f079ee50 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:31.654627 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2bc518ce-d455-4d9a-811c-37d9f079ee50 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:31.799427 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-2bc518ce-d455-4d9a-811c-37d9f079ee50 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f584ae6eae48e994c19ae3786b95d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017a524b579e48d2bc6fe99ab8332456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:31.836733 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-2bc518ce-d455-4d9a-811c-37d9f079ee50 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] 10.222.0.20 "GET /compute/v2.1/servers/49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e" status: 200 len: 1271 microversion: 2.1 time: 0.203586 Aug 09 02:41:31.850293 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 61/134] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:31 2022] GET /compute/v2.1/servers/49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e => generated 1271 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:31.947022 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [req-5c96d3b5-2688-4b3d-b6ff-f3cbdf89333d req-60a37f3b-e3eb-4b3d-844b-355a98787f2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f16a110-9dc8-4e95-b6de-c30feee35b89", "tag": "e1bca63c-8e79-4219-8848-c50bf228ba03"}]} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:41:31.954442 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-7cc25f26-0c02-4a78-bc08-d1199a49691a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:31.965360 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-7cc25f26-0c02-4a78-bc08-d1199a49691a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507" status: 200 len: 1321 microversion: 2.1 time: 0.418764 Aug 09 02:41:31.967274 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 74/135] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:31 2022] GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507 => generated 1321 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:31.981998 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-5c96d3b5-2688-4b3d-b6ff-f3cbdf89333d req-60a37f3b-e3eb-4b3d-844b-355a98787f2c service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:31.982620 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-5c96d3b5-2688-4b3d-b6ff-f3cbdf89333d req-60a37f3b-e3eb-4b3d-844b-355a98787f2c service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:31.983134 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-5c96d3b5-2688-4b3d-b6ff-f3cbdf89333d req-60a37f3b-e3eb-4b3d-844b-355a98787f2c service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:32.017900 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.compute.server_external_events [req-5c96d3b5-2688-4b3d-b6ff-f3cbdf89333d req-60a37f3b-e3eb-4b3d-844b-355a98787f2c service nova] Creating event network-changed:e1bca63c-8e79-4219-8848-c50bf228ba03 for instance 8f16a110-9dc8-4e95-b6de-c30feee35b89 on hv-cinder-85246 Aug 09 02:41:32.030446 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [req-5c96d3b5-2688-4b3d-b6ff-f3cbdf89333d req-60a37f3b-e3eb-4b3d-844b-355a98787f2c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089823 Aug 09 02:41:32.031375 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 62/136] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:41:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:41:32.865384 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-04953838-7898-44ef-9c4a-fe687db32a5a tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:32.866073 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-04953838-7898-44ef-9c4a-fe687db32a5a tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] [instance: 49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:32.874688 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-04953838-7898-44ef-9c4a-fe687db32a5a tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:32.875173 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-04953838-7898-44ef-9c4a-fe687db32a5a tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:32.878748 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-04953838-7898-44ef-9c4a-fe687db32a5a tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:32.880108 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-04953838-7898-44ef-9c4a-fe687db32a5a tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:32.880582 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-04953838-7898-44ef-9c4a-fe687db32a5a tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:32.881009 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-04953838-7898-44ef-9c4a-fe687db32a5a tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:32.993361 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-c56bdcf0-4c41-41b3-a967-5c8a69ccf0b3 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:32.994332 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-c56bdcf0-4c41-41b3-a967-5c8a69ccf0b3 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:33.005868 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c56bdcf0-4c41-41b3-a967-5c8a69ccf0b3 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:33.006741 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c56bdcf0-4c41-41b3-a967-5c8a69ccf0b3 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:33.007339 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c56bdcf0-4c41-41b3-a967-5c8a69ccf0b3 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:33.009006 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c56bdcf0-4c41-41b3-a967-5c8a69ccf0b3 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:33.009940 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c56bdcf0-4c41-41b3-a967-5c8a69ccf0b3 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:33.010549 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c56bdcf0-4c41-41b3-a967-5c8a69ccf0b3 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:33.326306 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-04953838-7898-44ef-9c4a-fe687db32a5a tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f584ae6eae48e994c19ae3786b95d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017a524b579e48d2bc6fe99ab8332456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:33.341279 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-04953838-7898-44ef-9c4a-fe687db32a5a tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] 10.222.0.20 "GET /compute/v2.1/servers/49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e" status: 200 len: 1271 microversion: 2.1 time: 0.479954 Aug 09 02:41:33.344505 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 75/137] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:32 2022] GET /compute/v2.1/servers/49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e => generated 1271 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:33.502668 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-c56bdcf0-4c41-41b3-a967-5c8a69ccf0b3 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:33.511735 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-c56bdcf0-4c41-41b3-a967-5c8a69ccf0b3 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507" status: 200 len: 1321 microversion: 2.1 time: 0.523848 Aug 09 02:41:33.512598 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 63/138] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:32 2022] GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507 => generated 1321 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:41:33.760956 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-ec66ca3a-4605-46d9-a6b4-bd6aea224546 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:33.762297 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-ec66ca3a-4605-46d9-a6b4-bd6aea224546 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] [instance: 1e614721-c888-4eaf-b834-42497e80345c] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:33.765354 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_cell0:SELECT=2 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:41:33.766225 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_cell0:SELECT=6 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:41:33.770312 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ec66ca3a-4605-46d9-a6b4-bd6aea224546 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:33.771675 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ec66ca3a-4605-46d9-a6b4-bd6aea224546 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:33.772292 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ec66ca3a-4605-46d9-a6b4-bd6aea224546 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:33.773206 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ec66ca3a-4605-46d9-a6b4-bd6aea224546 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:33.773869 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ec66ca3a-4605-46d9-a6b4-bd6aea224546 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:33.774452 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ec66ca3a-4605-46d9-a6b4-bd6aea224546 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:33.801175 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-ec66ca3a-4605-46d9-a6b4-bd6aea224546 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] [instance: 1e614721-c888-4eaf-b834-42497e80345c] Going to try to terminate instance {{(pid=124427) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 02:41:33.947452 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-ec66ca3a-4605-46d9-a6b4-bd6aea224546 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c" status: 204 len: 0 microversion: 2.1 time: 0.190410 Aug 09 02:41:33.949000 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 76/139] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 9 02:41:33 2022] DELETE /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 02:41:33.957235 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-e8fe07ea-48f8-4c01-93ee-e246fc796996 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:33.957860 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-e8fe07ea-48f8-4c01-93ee-e246fc796996 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] [instance: 1e614721-c888-4eaf-b834-42497e80345c] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:33.960122 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_cell0:SELECT=2 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:41:33.965867 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e8fe07ea-48f8-4c01-93ee-e246fc796996 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:33.966385 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e8fe07ea-48f8-4c01-93ee-e246fc796996 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:33.966820 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e8fe07ea-48f8-4c01-93ee-e246fc796996 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:33.967521 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e8fe07ea-48f8-4c01-93ee-e246fc796996 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:33.967969 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e8fe07ea-48f8-4c01-93ee-e246fc796996 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:33.968382 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e8fe07ea-48f8-4c01-93ee-e246fc796996 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:34.273869 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-e8fe07ea-48f8-4c01-93ee-e246fc796996 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113d48eb42524e62bfc95606f93f3736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f96c9ae9b44b91a4db2187160a5688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:34.287235 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-e8fe07ea-48f8-4c01-93ee-e246fc796996 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] 10.222.0.20 "GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c" status: 200 len: 1551 microversion: 2.1 time: 0.333571 Aug 09 02:41:34.310738 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 64/140] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:33 2022] GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c => generated 1551 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:34.366330 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-04b69592-7df8-424d-a4cf-e32a699cc676 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:34.367038 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-04b69592-7df8-424d-a4cf-e32a699cc676 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] [instance: 49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:34.379590 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-04b69592-7df8-424d-a4cf-e32a699cc676 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:34.380096 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-04b69592-7df8-424d-a4cf-e32a699cc676 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:34.380527 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-04b69592-7df8-424d-a4cf-e32a699cc676 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:34.382805 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-04b69592-7df8-424d-a4cf-e32a699cc676 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:34.383461 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-04b69592-7df8-424d-a4cf-e32a699cc676 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:34.386039 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-04b69592-7df8-424d-a4cf-e32a699cc676 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:34.535713 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-2b425a82-d854-4260-9f24-e0a81c9febe5 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:34.536920 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-2b425a82-d854-4260-9f24-e0a81c9febe5 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:34.543999 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2b425a82-d854-4260-9f24-e0a81c9febe5 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:34.544490 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2b425a82-d854-4260-9f24-e0a81c9febe5 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:34.545175 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2b425a82-d854-4260-9f24-e0a81c9febe5 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:34.545880 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2b425a82-d854-4260-9f24-e0a81c9febe5 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:34.546413 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2b425a82-d854-4260-9f24-e0a81c9febe5 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:34.546819 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2b425a82-d854-4260-9f24-e0a81c9febe5 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:34.632024 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-04b69592-7df8-424d-a4cf-e32a699cc676 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f584ae6eae48e994c19ae3786b95d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017a524b579e48d2bc6fe99ab8332456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:34.634597 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:41:34.647726 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-04b69592-7df8-424d-a4cf-e32a699cc676 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] 10.222.0.20 "GET /compute/v2.1/servers/49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e" status: 200 len: 1313 microversion: 2.1 time: 0.286134 Aug 09 02:41:34.648767 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 77/141] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:34 2022] GET /compute/v2.1/servers/49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e => generated 1313 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:34.789350 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-2b425a82-d854-4260-9f24-e0a81c9febe5 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:34.803673 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-2b425a82-d854-4260-9f24-e0a81c9febe5 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507" status: 200 len: 1321 microversion: 2.1 time: 0.274422 Aug 09 02:41:34.804989 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 65/142] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:34 2022] GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507 => generated 1321 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:35.312769 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-960c0bb3-155e-49e7-acbf-5c210afd0f06 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:35.313489 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-960c0bb3-155e-49e7-acbf-5c210afd0f06 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] [instance: 1e614721-c888-4eaf-b834-42497e80345c] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:35.320614 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-960c0bb3-155e-49e7-acbf-5c210afd0f06 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:35.321139 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-960c0bb3-155e-49e7-acbf-5c210afd0f06 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:35.321625 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-960c0bb3-155e-49e7-acbf-5c210afd0f06 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:35.322545 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-960c0bb3-155e-49e7-acbf-5c210afd0f06 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:35.322999 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-960c0bb3-155e-49e7-acbf-5c210afd0f06 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:35.323417 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-960c0bb3-155e-49e7-acbf-5c210afd0f06 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:35.493932 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-960c0bb3-155e-49e7-acbf-5c210afd0f06 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113d48eb42524e62bfc95606f93f3736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f96c9ae9b44b91a4db2187160a5688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:35.504507 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-960c0bb3-155e-49e7-acbf-5c210afd0f06 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] 10.222.0.20 "GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c" status: 200 len: 1551 microversion: 2.1 time: 0.195508 Aug 09 02:41:35.505587 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 78/143] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:35 2022] GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c => generated 1551 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:35.671502 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-19cfe209-e735-4a50-849c-85854d286ee9 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:35.672127 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-19cfe209-e735-4a50-849c-85854d286ee9 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] [instance: 49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:35.681394 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-19cfe209-e735-4a50-849c-85854d286ee9 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:35.681877 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-19cfe209-e735-4a50-849c-85854d286ee9 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:35.682332 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-19cfe209-e735-4a50-849c-85854d286ee9 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:35.684128 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-19cfe209-e735-4a50-849c-85854d286ee9 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:35.684427 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-19cfe209-e735-4a50-849c-85854d286ee9 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:35.684981 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-19cfe209-e735-4a50-849c-85854d286ee9 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:35.837011 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-c47f27a8-cbd5-43de-91cf-c6e6b8b3e997 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:35.838079 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-c47f27a8-cbd5-43de-91cf-c6e6b8b3e997 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:35.847952 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-c47f27a8-cbd5-43de-91cf-c6e6b8b3e997 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:35.849605 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-c47f27a8-cbd5-43de-91cf-c6e6b8b3e997 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:35.850071 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-c47f27a8-cbd5-43de-91cf-c6e6b8b3e997 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:35.851028 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-c47f27a8-cbd5-43de-91cf-c6e6b8b3e997 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:35.851623 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-c47f27a8-cbd5-43de-91cf-c6e6b8b3e997 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:35.852044 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-c47f27a8-cbd5-43de-91cf-c6e6b8b3e997 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:35.887233 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-19cfe209-e735-4a50-849c-85854d286ee9 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f584ae6eae48e994c19ae3786b95d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017a524b579e48d2bc6fe99ab8332456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:35.897007 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-19cfe209-e735-4a50-849c-85854d286ee9 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] 10.222.0.20 "GET /compute/v2.1/servers/49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e" status: 200 len: 1313 microversion: 2.1 time: 0.229464 Aug 09 02:41:35.897955 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 66/144] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:35 2022] GET /compute/v2.1/servers/49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e => generated 1313 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:36.075125 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-c47f27a8-cbd5-43de-91cf-c6e6b8b3e997 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:36.082652 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-c47f27a8-cbd5-43de-91cf-c6e6b8b3e997 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507" status: 200 len: 1321 microversion: 2.1 time: 0.262395 Aug 09 02:41:36.083485 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 79/145] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:35 2022] GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507 => generated 1321 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:41:36.528032 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-bbd9a51d-1f13-4d42-aee4-d5fad57b11ba tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:36.528767 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-bbd9a51d-1f13-4d42-aee4-d5fad57b11ba tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] [instance: 1e614721-c888-4eaf-b834-42497e80345c] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:36.537166 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-bbd9a51d-1f13-4d42-aee4-d5fad57b11ba tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:36.537667 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-bbd9a51d-1f13-4d42-aee4-d5fad57b11ba tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:36.538182 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-bbd9a51d-1f13-4d42-aee4-d5fad57b11ba tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:36.538878 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-bbd9a51d-1f13-4d42-aee4-d5fad57b11ba tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:36.539324 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-bbd9a51d-1f13-4d42-aee4-d5fad57b11ba tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:36.549351 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-bbd9a51d-1f13-4d42-aee4-d5fad57b11ba tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:36.918762 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-b130f753-5f0c-477b-97f8-486e53f27f29 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:36.920224 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-b130f753-5f0c-477b-97f8-486e53f27f29 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] [instance: 49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:36.931695 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b130f753-5f0c-477b-97f8-486e53f27f29 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:36.933831 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b130f753-5f0c-477b-97f8-486e53f27f29 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:36.934676 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b130f753-5f0c-477b-97f8-486e53f27f29 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:36.949841 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b130f753-5f0c-477b-97f8-486e53f27f29 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:36.951947 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b130f753-5f0c-477b-97f8-486e53f27f29 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:36.952502 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b130f753-5f0c-477b-97f8-486e53f27f29 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:37.214431 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-bbd9a51d-1f13-4d42-aee4-d5fad57b11ba tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113d48eb42524e62bfc95606f93f3736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f96c9ae9b44b91a4db2187160a5688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:37.241577 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-bbd9a51d-1f13-4d42-aee4-d5fad57b11ba tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] 10.222.0.20 "GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c" status: 200 len: 1551 microversion: 2.1 time: 0.718246 Aug 09 02:41:37.242698 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 67/146] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:36 2022] GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c => generated 1551 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:37.248528 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-6b6f2b6f-a6b2-46ff-8353-aeba3d920b8d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:37.249253 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-6b6f2b6f-a6b2-46ff-8353-aeba3d920b8d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:37.257555 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6b6f2b6f-a6b2-46ff-8353-aeba3d920b8d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:37.258042 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6b6f2b6f-a6b2-46ff-8353-aeba3d920b8d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:37.258511 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6b6f2b6f-a6b2-46ff-8353-aeba3d920b8d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:37.259269 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6b6f2b6f-a6b2-46ff-8353-aeba3d920b8d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:37.259719 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6b6f2b6f-a6b2-46ff-8353-aeba3d920b8d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:37.260135 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6b6f2b6f-a6b2-46ff-8353-aeba3d920b8d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:37.452142 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-b130f753-5f0c-477b-97f8-486e53f27f29 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f584ae6eae48e994c19ae3786b95d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017a524b579e48d2bc6fe99ab8332456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:37.460117 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-b130f753-5f0c-477b-97f8-486e53f27f29 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] 10.222.0.20 "GET /compute/v2.1/servers/49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e" status: 200 len: 1313 microversion: 2.1 time: 0.546016 Aug 09 02:41:37.461022 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 80/147] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:36 2022] GET /compute/v2.1/servers/49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e => generated 1313 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:41:37.528980 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [req-f0e3a14b-b8f4-41cb-b130-980668cc30fa req-2494c420-ca99-4012-927b-46e7b1942b90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e", "tag": "a682b349-80c7-44e8-838b-efa10e67c865"}]} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:41:37.543371 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-f0e3a14b-b8f4-41cb-b130-980668cc30fa req-2494c420-ca99-4012-927b-46e7b1942b90 service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:37.544240 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-f0e3a14b-b8f4-41cb-b130-980668cc30fa req-2494c420-ca99-4012-927b-46e7b1942b90 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:37.547385 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-f0e3a14b-b8f4-41cb-b130-980668cc30fa req-2494c420-ca99-4012-927b-46e7b1942b90 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:37.580698 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.compute.server_external_events [req-f0e3a14b-b8f4-41cb-b130-980668cc30fa req-2494c420-ca99-4012-927b-46e7b1942b90 service nova] Creating event network-changed:a682b349-80c7-44e8-838b-efa10e67c865 for instance 49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e on hv-cinder-85246 Aug 09 02:41:37.591245 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [req-f0e3a14b-b8f4-41cb-b130-980668cc30fa req-2494c420-ca99-4012-927b-46e7b1942b90 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066941 Aug 09 02:41:37.592526 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 81/148] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:41:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 02:41:37.695063 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-6b6f2b6f-a6b2-46ff-8353-aeba3d920b8d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:37.695063 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-6b6f2b6f-a6b2-46ff-8353-aeba3d920b8d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507" status: 200 len: 1515 microversion: 2.1 time: 0.450230 Aug 09 02:41:37.695823 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 68/149] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:37 2022] GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507 => generated 1515 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:37.719087 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-9978f430-80f3-44a7-b41c-6258b2eadb55 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:41:37.722533 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-9978f430-80f3-44a7-b41c-6258b2eadb55 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:37.730705 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9978f430-80f3-44a7-b41c-6258b2eadb55 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:37.732025 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9978f430-80f3-44a7-b41c-6258b2eadb55 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:37.732833 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9978f430-80f3-44a7-b41c-6258b2eadb55 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:37.733708 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9978f430-80f3-44a7-b41c-6258b2eadb55 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:37.734345 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9978f430-80f3-44a7-b41c-6258b2eadb55 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:37.734922 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9978f430-80f3-44a7-b41c-6258b2eadb55 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:37.779400 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.objects.instance [None req-9978f430-80f3-44a7-b41c-6258b2eadb55 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lazy-loading 'flavor' on Instance uuid 4571cba1-e225-40c3-aa20-12c3802c6507 {{(pid=124427) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 02:41:37.927955 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-9978f430-80f3-44a7-b41c-6258b2eadb55 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "POST /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507/action" status: 200 len: 32 microversion: 2.1 time: 0.214756 Aug 09 02:41:37.934355 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 82/150] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Aug 9 02:41:37 2022] POST /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507/action => generated 32 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 02:41:37.940162 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-cbc0362d-16a9-4c94-a05e-8a1f822e18b2 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:37.940848 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-cbc0362d-16a9-4c94-a05e-8a1f822e18b2 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:37.947814 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-cbc0362d-16a9-4c94-a05e-8a1f822e18b2 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:37.948299 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-cbc0362d-16a9-4c94-a05e-8a1f822e18b2 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:37.948724 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-cbc0362d-16a9-4c94-a05e-8a1f822e18b2 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:37.949584 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-cbc0362d-16a9-4c94-a05e-8a1f822e18b2 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:37.950212 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-cbc0362d-16a9-4c94-a05e-8a1f822e18b2 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:37.950632 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-cbc0362d-16a9-4c94-a05e-8a1f822e18b2 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:38.136581 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-cbc0362d-16a9-4c94-a05e-8a1f822e18b2 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:38.164400 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-cbc0362d-16a9-4c94-a05e-8a1f822e18b2 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507" status: 200 len: 1521 microversion: 2.1 time: 0.228686 Aug 09 02:41:38.165256 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 69/151] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:37 2022] GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507 => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:38.267644 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-0fd75f8b-07bc-413f-8fe1-b58dfd9c8459 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:38.269091 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-0fd75f8b-07bc-413f-8fe1-b58dfd9c8459 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] [instance: 1e614721-c888-4eaf-b834-42497e80345c] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:38.279416 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0fd75f8b-07bc-413f-8fe1-b58dfd9c8459 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:38.280200 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0fd75f8b-07bc-413f-8fe1-b58dfd9c8459 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:38.280635 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0fd75f8b-07bc-413f-8fe1-b58dfd9c8459 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:38.281504 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0fd75f8b-07bc-413f-8fe1-b58dfd9c8459 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:38.282250 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0fd75f8b-07bc-413f-8fe1-b58dfd9c8459 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:38.283081 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0fd75f8b-07bc-413f-8fe1-b58dfd9c8459 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:38.445458 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-0fd75f8b-07bc-413f-8fe1-b58dfd9c8459 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113d48eb42524e62bfc95606f93f3736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f96c9ae9b44b91a4db2187160a5688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:38.459141 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-0fd75f8b-07bc-413f-8fe1-b58dfd9c8459 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] 10.222.0.20 "GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c" status: 200 len: 1551 microversion: 2.1 time: 0.197714 Aug 09 02:41:38.460135 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 83/152] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:38 2022] GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c => generated 1551 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:38.482373 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-6eac1c42-2c8f-4817-ab8f-526a0fd8d69a tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:38.484525 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-6eac1c42-2c8f-4817-ab8f-526a0fd8d69a tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] [instance: 49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:38.493664 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6eac1c42-2c8f-4817-ab8f-526a0fd8d69a tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:38.494869 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6eac1c42-2c8f-4817-ab8f-526a0fd8d69a tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:38.495450 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6eac1c42-2c8f-4817-ab8f-526a0fd8d69a tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:38.496572 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6eac1c42-2c8f-4817-ab8f-526a0fd8d69a tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:38.497775 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6eac1c42-2c8f-4817-ab8f-526a0fd8d69a tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:38.501468 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6eac1c42-2c8f-4817-ab8f-526a0fd8d69a tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:38.646449 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-6eac1c42-2c8f-4817-ab8f-526a0fd8d69a tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f584ae6eae48e994c19ae3786b95d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017a524b579e48d2bc6fe99ab8332456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:38.655068 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-6eac1c42-2c8f-4817-ab8f-526a0fd8d69a tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] 10.222.0.20 "GET /compute/v2.1/servers/49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e" status: 200 len: 1313 microversion: 2.1 time: 0.177617 Aug 09 02:41:38.655945 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 70/153] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:38 2022] GET /compute/v2.1/servers/49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:39.185487 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-3b01f84f-52e4-4c47-94f2-0f43cb7ec7fb tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:39.186317 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-3b01f84f-52e4-4c47-94f2-0f43cb7ec7fb tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:39.194228 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3b01f84f-52e4-4c47-94f2-0f43cb7ec7fb tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:39.194724 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3b01f84f-52e4-4c47-94f2-0f43cb7ec7fb tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:39.195240 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3b01f84f-52e4-4c47-94f2-0f43cb7ec7fb tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:39.196014 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3b01f84f-52e4-4c47-94f2-0f43cb7ec7fb tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:39.196381 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3b01f84f-52e4-4c47-94f2-0f43cb7ec7fb tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:39.196804 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3b01f84f-52e4-4c47-94f2-0f43cb7ec7fb tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:39.450315 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-3b01f84f-52e4-4c47-94f2-0f43cb7ec7fb tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:39.467641 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-3b01f84f-52e4-4c47-94f2-0f43cb7ec7fb tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507" status: 200 len: 1521 microversion: 2.1 time: 0.284460 Aug 09 02:41:39.468652 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 84/154] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:39 2022] GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507 => generated 1521 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:39.481405 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-ef3efa95-d940-4056-8282-0df331ea0b23 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:39.482112 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-ef3efa95-d940-4056-8282-0df331ea0b23 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] [instance: 1e614721-c888-4eaf-b834-42497e80345c] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:39.491132 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ef3efa95-d940-4056-8282-0df331ea0b23 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:39.492357 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ef3efa95-d940-4056-8282-0df331ea0b23 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:39.493008 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ef3efa95-d940-4056-8282-0df331ea0b23 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:39.493847 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ef3efa95-d940-4056-8282-0df331ea0b23 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:39.494369 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ef3efa95-d940-4056-8282-0df331ea0b23 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:39.494854 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ef3efa95-d940-4056-8282-0df331ea0b23 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:39.510656 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_cell1:SELECT=100 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:41:39.673683 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-ef3efa95-d940-4056-8282-0df331ea0b23 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113d48eb42524e62bfc95606f93f3736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f96c9ae9b44b91a4db2187160a5688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:39.678780 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-ebfe6d43-70c4-44a1-9250-0a8ae09750dd tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:39.680997 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-ebfe6d43-70c4-44a1-9250-0a8ae09750dd tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] [instance: 49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:39.682305 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-ef3efa95-d940-4056-8282-0df331ea0b23 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] 10.222.0.20 "GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c" status: 200 len: 1551 microversion: 2.1 time: 0.205844 Aug 09 02:41:39.683265 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 71/155] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:39 2022] GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c => generated 1551 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:39.689216 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ebfe6d43-70c4-44a1-9250-0a8ae09750dd tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:39.689892 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ebfe6d43-70c4-44a1-9250-0a8ae09750dd tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:39.690427 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ebfe6d43-70c4-44a1-9250-0a8ae09750dd tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:39.691237 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ebfe6d43-70c4-44a1-9250-0a8ae09750dd tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:39.691799 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ebfe6d43-70c4-44a1-9250-0a8ae09750dd tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:39.692366 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ebfe6d43-70c4-44a1-9250-0a8ae09750dd tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:39.924787 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-ebfe6d43-70c4-44a1-9250-0a8ae09750dd tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f584ae6eae48e994c19ae3786b95d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017a524b579e48d2bc6fe99ab8332456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:39.935302 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-ebfe6d43-70c4-44a1-9250-0a8ae09750dd tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] 10.222.0.20 "GET /compute/v2.1/servers/49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e" status: 200 len: 1313 microversion: 2.1 time: 0.260282 Aug 09 02:41:39.936511 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 85/156] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:39 2022] GET /compute/v2.1/servers/49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e => generated 1313 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:40.489210 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-504d9708-e36b-4f86-9569-b74cf99f78e4 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:40.489921 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-504d9708-e36b-4f86-9569-b74cf99f78e4 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:40.496481 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-504d9708-e36b-4f86-9569-b74cf99f78e4 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:40.497843 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-504d9708-e36b-4f86-9569-b74cf99f78e4 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:40.498439 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-504d9708-e36b-4f86-9569-b74cf99f78e4 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:40.499308 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-504d9708-e36b-4f86-9569-b74cf99f78e4 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:40.500007 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-504d9708-e36b-4f86-9569-b74cf99f78e4 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:40.500845 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-504d9708-e36b-4f86-9569-b74cf99f78e4 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:40.679731 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-504d9708-e36b-4f86-9569-b74cf99f78e4 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:40.689607 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-504d9708-e36b-4f86-9569-b74cf99f78e4 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507" status: 200 len: 1521 microversion: 2.1 time: 0.204389 Aug 09 02:41:40.690672 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 72/157] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:40 2022] GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:40.705961 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-e6086848-9221-4ea1-bf4b-a409948b53e0 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:40.706603 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-e6086848-9221-4ea1-bf4b-a409948b53e0 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] [instance: 1e614721-c888-4eaf-b834-42497e80345c] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:40.712895 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e6086848-9221-4ea1-bf4b-a409948b53e0 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:40.713632 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e6086848-9221-4ea1-bf4b-a409948b53e0 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:40.714287 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e6086848-9221-4ea1-bf4b-a409948b53e0 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:40.715000 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e6086848-9221-4ea1-bf4b-a409948b53e0 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:40.715682 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e6086848-9221-4ea1-bf4b-a409948b53e0 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:40.716165 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e6086848-9221-4ea1-bf4b-a409948b53e0 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:40.957916 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-21620e7b-d893-4bc0-9d98-a87b6f9aab7d tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:40.958979 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-21620e7b-d893-4bc0-9d98-a87b6f9aab7d tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] [instance: 49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:40.969319 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-21620e7b-d893-4bc0-9d98-a87b6f9aab7d tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:40.970397 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-21620e7b-d893-4bc0-9d98-a87b6f9aab7d tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:40.972049 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-21620e7b-d893-4bc0-9d98-a87b6f9aab7d tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:40.973395 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-21620e7b-d893-4bc0-9d98-a87b6f9aab7d tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:40.974288 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-21620e7b-d893-4bc0-9d98-a87b6f9aab7d tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:40.974991 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-21620e7b-d893-4bc0-9d98-a87b6f9aab7d tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:41.030883 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-e6086848-9221-4ea1-bf4b-a409948b53e0 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113d48eb42524e62bfc95606f93f3736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f96c9ae9b44b91a4db2187160a5688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:41.042870 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-e6086848-9221-4ea1-bf4b-a409948b53e0 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] 10.222.0.20 "GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c" status: 200 len: 1551 microversion: 2.1 time: 0.342634 Aug 09 02:41:41.044125 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 86/158] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:40 2022] GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c => generated 1551 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:41.163210 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-21620e7b-d893-4bc0-9d98-a87b6f9aab7d tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f584ae6eae48e994c19ae3786b95d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017a524b579e48d2bc6fe99ab8332456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:41.180570 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-21620e7b-d893-4bc0-9d98-a87b6f9aab7d tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] 10.222.0.20 "GET /compute/v2.1/servers/49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e" status: 200 len: 1313 microversion: 2.1 time: 0.226312 Aug 09 02:41:41.183941 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 73/159] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:40 2022] GET /compute/v2.1/servers/49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e => generated 1313 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:41.727776 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-574a92fe-09d5-49fb-bab9-9cd8cea9a15e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:41.728374 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-574a92fe-09d5-49fb-bab9-9cd8cea9a15e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:41.738060 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-574a92fe-09d5-49fb-bab9-9cd8cea9a15e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:41.738631 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-574a92fe-09d5-49fb-bab9-9cd8cea9a15e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:41.739060 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-574a92fe-09d5-49fb-bab9-9cd8cea9a15e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:41.743829 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-574a92fe-09d5-49fb-bab9-9cd8cea9a15e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:41.744309 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-574a92fe-09d5-49fb-bab9-9cd8cea9a15e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:41.744729 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-574a92fe-09d5-49fb-bab9-9cd8cea9a15e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:42.065640 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-fa331da8-7709-4d0b-9eaa-400032632f1d tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:42.066799 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-fa331da8-7709-4d0b-9eaa-400032632f1d tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] [instance: 1e614721-c888-4eaf-b834-42497e80345c] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:42.075759 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-fa331da8-7709-4d0b-9eaa-400032632f1d tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:42.078877 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-fa331da8-7709-4d0b-9eaa-400032632f1d tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:42.079552 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-fa331da8-7709-4d0b-9eaa-400032632f1d tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:42.083816 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-fa331da8-7709-4d0b-9eaa-400032632f1d tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:42.084477 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-fa331da8-7709-4d0b-9eaa-400032632f1d tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:42.086772 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-fa331da8-7709-4d0b-9eaa-400032632f1d tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:42.998995 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-574a92fe-09d5-49fb-bab9-9cd8cea9a15e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:43.008260 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-574a92fe-09d5-49fb-bab9-9cd8cea9a15e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507" status: 200 len: 1521 microversion: 2.1 time: 1.292670 Aug 09 02:41:43.041765 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 87/160] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:41 2022] GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507 => generated 1521 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:43.051390 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-0aa896b6-8a82-47ff-8575-be68784e70ab tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:43.054666 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-0aa896b6-8a82-47ff-8575-be68784e70ab tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] [instance: 49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:43.070204 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0aa896b6-8a82-47ff-8575-be68784e70ab tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:43.070757 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0aa896b6-8a82-47ff-8575-be68784e70ab tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:43.071124 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0aa896b6-8a82-47ff-8575-be68784e70ab tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:43.075207 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0aa896b6-8a82-47ff-8575-be68784e70ab tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:43.077230 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0aa896b6-8a82-47ff-8575-be68784e70ab tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:43.078930 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0aa896b6-8a82-47ff-8575-be68784e70ab tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:43.098824 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-fa331da8-7709-4d0b-9eaa-400032632f1d tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113d48eb42524e62bfc95606f93f3736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f96c9ae9b44b91a4db2187160a5688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:43.113665 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-fa331da8-7709-4d0b-9eaa-400032632f1d tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] 10.222.0.20 "GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c" status: 200 len: 1551 microversion: 2.1 time: 1.053124 Aug 09 02:41:43.134245 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 74/161] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:42 2022] GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c => generated 1551 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:41:43.150975 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [req-a8cd0dba-4417-4e91-99fe-21d717e7d52d req-f5af4b73-4b84-4112-bbd5-16c601f027dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e614721-c888-4eaf-b834-42497e80345c", "name": "network-vif-unplugged", "status": "completed", "tag": "d01cee1a-247a-4147-8cbe-c15281979780"}]} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:41:43.184866 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-a8cd0dba-4417-4e91-99fe-21d717e7d52d req-f5af4b73-4b84-4112-bbd5-16c601f027dc service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:43.185556 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-a8cd0dba-4417-4e91-99fe-21d717e7d52d req-f5af4b73-4b84-4112-bbd5-16c601f027dc service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:43.187394 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-a8cd0dba-4417-4e91-99fe-21d717e7d52d req-f5af4b73-4b84-4112-bbd5-16c601f027dc service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:43.218788 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.compute.server_external_events [req-a8cd0dba-4417-4e91-99fe-21d717e7d52d req-f5af4b73-4b84-4112-bbd5-16c601f027dc service nova] Creating event network-vif-unplugged:d01cee1a-247a-4147-8cbe-c15281979780 for instance 1e614721-c888-4eaf-b834-42497e80345c on hv-cinder-85246 Aug 09 02:41:43.228848 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [req-a8cd0dba-4417-4e91-99fe-21d717e7d52d req-f5af4b73-4b84-4112-bbd5-16c601f027dc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089168 Aug 09 02:41:43.231567 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 75/162] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:41:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:41:43.450579 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-0aa896b6-8a82-47ff-8575-be68784e70ab tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f584ae6eae48e994c19ae3786b95d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017a524b579e48d2bc6fe99ab8332456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:43.466902 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-0aa896b6-8a82-47ff-8575-be68784e70ab tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] 10.222.0.20 "GET /compute/v2.1/servers/49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e" status: 200 len: 1313 microversion: 2.1 time: 0.423835 Aug 09 02:41:43.467493 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 88/163] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:43 2022] GET /compute/v2.1/servers/49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e => generated 1313 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:43.804755 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [req-94907409-40bc-457f-a196-924a2dbe1ce0 req-67b7f4de-9622-4673-a82a-803a3d5b9929 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e614721-c888-4eaf-b834-42497e80345c", "name": "network-vif-deleted", "tag": "d01cee1a-247a-4147-8cbe-c15281979780"}]} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:41:43.837367 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-94907409-40bc-457f-a196-924a2dbe1ce0 req-67b7f4de-9622-4673-a82a-803a3d5b9929 service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:43.838113 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-94907409-40bc-457f-a196-924a2dbe1ce0 req-67b7f4de-9622-4673-a82a-803a3d5b9929 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:43.838734 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-94907409-40bc-457f-a196-924a2dbe1ce0 req-67b7f4de-9622-4673-a82a-803a3d5b9929 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:43.868584 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.compute.server_external_events [req-94907409-40bc-457f-a196-924a2dbe1ce0 req-67b7f4de-9622-4673-a82a-803a3d5b9929 service nova] Creating event network-vif-deleted:d01cee1a-247a-4147-8cbe-c15281979780 for instance 1e614721-c888-4eaf-b834-42497e80345c on hv-cinder-85246 Aug 09 02:41:43.884705 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [req-94907409-40bc-457f-a196-924a2dbe1ce0 req-67b7f4de-9622-4673-a82a-803a3d5b9929 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084560 Aug 09 02:41:43.885510 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 76/164] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:41:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 02:41:44.029234 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-b2be483c-e1b4-49bd-86b0-cf2be27fa1c8 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:44.035468 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-b2be483c-e1b4-49bd-86b0-cf2be27fa1c8 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:44.046850 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b2be483c-e1b4-49bd-86b0-cf2be27fa1c8 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:44.047643 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b2be483c-e1b4-49bd-86b0-cf2be27fa1c8 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:44.048249 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b2be483c-e1b4-49bd-86b0-cf2be27fa1c8 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:44.051135 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b2be483c-e1b4-49bd-86b0-cf2be27fa1c8 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:44.053347 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b2be483c-e1b4-49bd-86b0-cf2be27fa1c8 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:44.053961 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b2be483c-e1b4-49bd-86b0-cf2be27fa1c8 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:44.140318 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-f4821214-3fd4-4542-ab27-cc8135808af8 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:44.141711 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-f4821214-3fd4-4542-ab27-cc8135808af8 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] [instance: 1e614721-c888-4eaf-b834-42497e80345c] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:44.148631 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f4821214-3fd4-4542-ab27-cc8135808af8 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:44.149584 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f4821214-3fd4-4542-ab27-cc8135808af8 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:44.150371 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f4821214-3fd4-4542-ab27-cc8135808af8 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:44.151373 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f4821214-3fd4-4542-ab27-cc8135808af8 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:44.152152 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f4821214-3fd4-4542-ab27-cc8135808af8 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:44.152730 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f4821214-3fd4-4542-ab27-cc8135808af8 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:44.355786 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-f4821214-3fd4-4542-ab27-cc8135808af8 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113d48eb42524e62bfc95606f93f3736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f96c9ae9b44b91a4db2187160a5688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:44.367177 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-f4821214-3fd4-4542-ab27-cc8135808af8 tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] 10.222.0.20 "GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c" status: 200 len: 1509 microversion: 2.1 time: 0.231445 Aug 09 02:41:44.379516 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 77/165] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:44 2022] GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c => generated 1509 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:41:44.493933 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-1b617754-1fea-4db8-be13-3b9e4e336e61 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:44.494602 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-1b617754-1fea-4db8-be13-3b9e4e336e61 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] [instance: 49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:44.503986 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1b617754-1fea-4db8-be13-3b9e4e336e61 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:44.505597 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1b617754-1fea-4db8-be13-3b9e4e336e61 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:44.506045 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1b617754-1fea-4db8-be13-3b9e4e336e61 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:44.508952 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1b617754-1fea-4db8-be13-3b9e4e336e61 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:44.509423 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1b617754-1fea-4db8-be13-3b9e4e336e61 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:44.510761 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1b617754-1fea-4db8-be13-3b9e4e336e61 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:44.516442 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-b2be483c-e1b4-49bd-86b0-cf2be27fa1c8 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:44.525664 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-b2be483c-e1b4-49bd-86b0-cf2be27fa1c8 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507" status: 200 len: 1521 microversion: 2.1 time: 0.500359 Aug 09 02:41:44.529607 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 89/166] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:44 2022] GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507 => generated 1521 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:45.172719 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-1b617754-1fea-4db8-be13-3b9e4e336e61 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f584ae6eae48e994c19ae3786b95d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017a524b579e48d2bc6fe99ab8332456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:45.183341 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-1b617754-1fea-4db8-be13-3b9e4e336e61 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] 10.222.0.20 "GET /compute/v2.1/servers/49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e" status: 200 len: 1313 microversion: 2.1 time: 0.696387 Aug 09 02:41:45.199752 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 78/167] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:44 2022] GET /compute/v2.1/servers/49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e => generated 1313 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:41:45.401172 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-2d960df3-b571-42e8-a537-a26c85baf12b tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:45.402529 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-2d960df3-b571-42e8-a537-a26c85baf12b tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] [instance: 1e614721-c888-4eaf-b834-42497e80345c] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:45.413115 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2d960df3-b571-42e8-a537-a26c85baf12b tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:45.414765 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2d960df3-b571-42e8-a537-a26c85baf12b tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:45.428664 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2d960df3-b571-42e8-a537-a26c85baf12b tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:45.428664 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2d960df3-b571-42e8-a537-a26c85baf12b tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:45.428664 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2d960df3-b571-42e8-a537-a26c85baf12b tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:45.428664 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2d960df3-b571-42e8-a537-a26c85baf12b tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:45.473386 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2d960df3-b571-42e8-a537-a26c85baf12b tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:45.474133 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2d960df3-b571-42e8-a537-a26c85baf12b tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:45.474917 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2d960df3-b571-42e8-a537-a26c85baf12b tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:45.475632 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.objects.instance [None req-2d960df3-b571-42e8-a537-a26c85baf12b tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lazy-loading 'fault' on Instance uuid 1e614721-c888-4eaf-b834-42497e80345c {{(pid=124427) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 02:41:45.551644 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-a2bcda8a-d05f-4351-8c0e-9a2505cbc9be tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:45.552420 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-a2bcda8a-d05f-4351-8c0e-9a2505cbc9be tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:45.559839 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a2bcda8a-d05f-4351-8c0e-9a2505cbc9be tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:45.560759 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a2bcda8a-d05f-4351-8c0e-9a2505cbc9be tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:45.561290 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a2bcda8a-d05f-4351-8c0e-9a2505cbc9be tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:45.561631 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-2d960df3-b571-42e8-a537-a26c85baf12b tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113d48eb42524e62bfc95606f93f3736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f96c9ae9b44b91a4db2187160a5688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:45.562259 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a2bcda8a-d05f-4351-8c0e-9a2505cbc9be tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:45.562881 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a2bcda8a-d05f-4351-8c0e-9a2505cbc9be tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:45.563393 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a2bcda8a-d05f-4351-8c0e-9a2505cbc9be tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:45.580758 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-2d960df3-b571-42e8-a537-a26c85baf12b tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] 10.222.0.20 "GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c" status: 200 len: 1349 microversion: 2.1 time: 0.183882 Aug 09 02:41:45.581834 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 90/168] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:45 2022] GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c => generated 1349 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:45.906525 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-a2bcda8a-d05f-4351-8c0e-9a2505cbc9be tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:45.919777 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-a2bcda8a-d05f-4351-8c0e-9a2505cbc9be tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507" status: 200 len: 1521 microversion: 2.1 time: 0.373903 Aug 09 02:41:45.921430 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 79/169] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:45 2022] GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507 => generated 1521 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:46.207909 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-fc1d2c93-16c0-451e-a14c-2b0ece22432d tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:46.208798 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-fc1d2c93-16c0-451e-a14c-2b0ece22432d tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] [instance: 49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:46.218253 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-fc1d2c93-16c0-451e-a14c-2b0ece22432d tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:46.219284 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-fc1d2c93-16c0-451e-a14c-2b0ece22432d tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:46.219869 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-fc1d2c93-16c0-451e-a14c-2b0ece22432d tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:46.221276 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-fc1d2c93-16c0-451e-a14c-2b0ece22432d tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:46.222745 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-fc1d2c93-16c0-451e-a14c-2b0ece22432d tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:46.223297 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-fc1d2c93-16c0-451e-a14c-2b0ece22432d tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:46.409111 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-fc1d2c93-16c0-451e-a14c-2b0ece22432d tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f584ae6eae48e994c19ae3786b95d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017a524b579e48d2bc6fe99ab8332456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:46.421528 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-fc1d2c93-16c0-451e-a14c-2b0ece22432d tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] 10.222.0.20 "GET /compute/v2.1/servers/49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e" status: 200 len: 1313 microversion: 2.1 time: 0.220404 Aug 09 02:41:46.422242 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 91/170] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:46 2022] GET /compute/v2.1/servers/49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e => generated 1313 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:46.603568 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-27d08be3-ebfa-4e44-a5b5-caa28dc4d99b tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:46.605405 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-27d08be3-ebfa-4e44-a5b5-caa28dc4d99b tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] [instance: 1e614721-c888-4eaf-b834-42497e80345c] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:46.614725 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-27d08be3-ebfa-4e44-a5b5-caa28dc4d99b tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:46.615590 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-27d08be3-ebfa-4e44-a5b5-caa28dc4d99b tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:46.616194 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-27d08be3-ebfa-4e44-a5b5-caa28dc4d99b tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:46.618654 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-27d08be3-ebfa-4e44-a5b5-caa28dc4d99b tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:46.619271 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-27d08be3-ebfa-4e44-a5b5-caa28dc4d99b tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:46.620304 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-27d08be3-ebfa-4e44-a5b5-caa28dc4d99b tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:46.639387 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.wsgi [None req-27d08be3-ebfa-4e44-a5b5-caa28dc4d99b tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] HTTP exception thrown: Instance 1e614721-c888-4eaf-b834-42497e80345c could not be found. Aug 09 02:41:46.644903 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-27d08be3-ebfa-4e44-a5b5-caa28dc4d99b tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Request method failure captured: Aug 09 02:41:46.644903 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: request: GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c HTTP/1.1 Aug 09 02:41:46.644903 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Accept: application/json Aug 09 02:41:46.644903 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Accept-Encoding: identity Aug 09 02:41:46.644903 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Connection: close Aug 09 02:41:46.644903 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Content-Length: 0 Aug 09 02:41:46.644903 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Content-Type: application/json Aug 09 02:41:46.644903 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Host: 10.222.0.20 Aug 09 02:41:46.644903 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Openstack-System-Scope: None Aug 09 02:41:46.644903 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: User-Agent: python-urllib3/1.26.11 Aug 09 02:41:46.644903 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Auth-Token: gAAAAABi8ckaE9sW9m9XwJCDR7Vx1uQd-9b5RqrD40ywOYvxq8AhKWNoz8FWiqff0sgzX6u4A9pI6kM6mWjTkPP9fDyD3k0jQrlNTt4mNIeFyBZagbGOL0yZ1QWWonK23SQFVwFrCzwRX4b4GQAk69bXBW94lo4sP5-7gUhfuzDNhE4zSUVb1Bo Aug 09 02:41:46.644903 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Domain-Id: None Aug 09 02:41:46.644903 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Domain-Name: None Aug 09 02:41:46.644903 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Identity-Status: Confirmed Aug 09 02:41:46.644903 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Is-Admin-Project: True Aug 09 02:41:46.644903 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Domain-Id: default Aug 09 02:41:46.644903 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Domain-Name: Default Aug 09 02:41:46.644903 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Id: 88f96c9ae9b44b91a4db2187160a5688 Aug 09 02:41:46.644903 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Name: tempest-DeleteServersTestJSON-453863208 Aug 09 02:41:46.644903 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Role: reader,member Aug 09 02:41:46.644903 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Roles: reader,member Aug 09 02:41:46.646525 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/88f96c9ae9b44b91a4db2187160a5688"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/88f96c9ae9b44b91a4db2187160a5688"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_88f96c9ae9b44b91a4db2187160a5688"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/88f96c9ae9b44b91a4db2187160a5688"}]}] Aug 09 02:41:46.646525 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant: tempest-DeleteServersTestJSON-453863208 Aug 09 02:41:46.646525 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant-Id: 88f96c9ae9b44b91a4db2187160a5688 Aug 09 02:41:46.646525 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant-Name: tempest-DeleteServersTestJSON-453863208 Aug 09 02:41:46.646525 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User: tempest-DeleteServersTestJSON-453863208-project Aug 09 02:41:46.646525 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Domain-Id: default Aug 09 02:41:46.646525 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Domain-Name: Default Aug 09 02:41:46.646525 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Id: 113d48eb42524e62bfc95606f93f3736 Aug 09 02:41:46.646525 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Name: tempest-DeleteServersTestJSON-453863208-project Aug 09 02:41:46.646525 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: method: > Aug 09 02:41:46.646525 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: exception: Instance 1e614721-c888-4eaf-b834-42497e80345c could not be found. Aug 09 02:41:46.646525 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: action_args: {'id': '1e614721-c888-4eaf-b834-42497e80345c'} Aug 09 02:41:46.647398 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 02:41:46.647398 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:41:46.647398 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 02:41:46.647398 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 02:41:46.647398 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 02:41:46.647398 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 02:41:46.647398 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 02:41:46.647398 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 02:41:46.647398 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 02:41:46.647398 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 02:41:46.647398 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e614721-c888-4eaf-b834-42497e80345c could not be found. Aug 09 02:41:46.647398 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:41:46.647398 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:41:46.647398 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:41:46.647398 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:41:46.647398 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:41:46.647398 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:41:46.647398 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 02:41:46.647398 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 02:41:46.647398 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 02:41:46.648795 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 02:41:46.648795 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 02:41:46.648795 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 02:41:46.648795 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 02:41:46.648795 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 02:41:46.648795 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 02:41:46.648795 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 02:41:46.648795 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e614721-c888-4eaf-b834-42497e80345c could not be found. Aug 09 02:41:46.648795 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:41:46.648795 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:41:46.648795 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:41:46.648795 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:41:46.648795 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:41:46.648795 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:41:46.648795 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 02:41:46.648795 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 02:41:46.648795 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e614721-c888-4eaf-b834-42497e80345c could not be found. Aug 09 02:41:46.648795 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:41:46.651468 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-27d08be3-ebfa-4e44-a5b5-caa28dc4d99b tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Returning 404 to user: Instance 1e614721-c888-4eaf-b834-42497e80345c could not be found. {{(pid=124425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 02:41:46.653456 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-27d08be3-ebfa-4e44-a5b5-caa28dc4d99b tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] 10.222.0.20 "GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c" status: 404 len: 111 microversion: 2.1 time: 0.054426 Aug 09 02:41:46.654523 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 80/171] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:46 2022] GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 02:41:46.853877 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-1f487d75-1d49-4a3a-9df0-2b31789624ee tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:46.859164 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-1f487d75-1d49-4a3a-9df0-2b31789624ee tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] [instance: 1e614721-c888-4eaf-b834-42497e80345c] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:46.875721 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1f487d75-1d49-4a3a-9df0-2b31789624ee tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:46.876227 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1f487d75-1d49-4a3a-9df0-2b31789624ee tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:46.876662 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1f487d75-1d49-4a3a-9df0-2b31789624ee tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:46.878071 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1f487d75-1d49-4a3a-9df0-2b31789624ee tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:46.878718 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1f487d75-1d49-4a3a-9df0-2b31789624ee tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:46.879527 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1f487d75-1d49-4a3a-9df0-2b31789624ee tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:46.903420 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.wsgi [None req-1f487d75-1d49-4a3a-9df0-2b31789624ee tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] HTTP exception thrown: Instance 1e614721-c888-4eaf-b834-42497e80345c could not be found. Aug 09 02:41:46.912367 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-1f487d75-1d49-4a3a-9df0-2b31789624ee tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Request method failure captured: Aug 09 02:41:46.912367 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: request: GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c/os-volume_attachments HTTP/1.1 Aug 09 02:41:46.912367 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Accept: application/json Aug 09 02:41:46.912367 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Accept-Encoding: identity Aug 09 02:41:46.912367 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Connection: close Aug 09 02:41:46.912367 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Content-Length: 0 Aug 09 02:41:46.912367 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Content-Type: application/json Aug 09 02:41:46.912367 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Host: 10.222.0.20 Aug 09 02:41:46.912367 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Openstack-System-Scope: None Aug 09 02:41:46.912367 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: User-Agent: python-urllib3/1.26.11 Aug 09 02:41:46.912367 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Auth-Token: gAAAAABi8ckaE9sW9m9XwJCDR7Vx1uQd-9b5RqrD40ywOYvxq8AhKWNoz8FWiqff0sgzX6u4A9pI6kM6mWjTkPP9fDyD3k0jQrlNTt4mNIeFyBZagbGOL0yZ1QWWonK23SQFVwFrCzwRX4b4GQAk69bXBW94lo4sP5-7gUhfuzDNhE4zSUVb1Bo Aug 09 02:41:46.912367 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Domain-Id: None Aug 09 02:41:46.912367 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Domain-Name: None Aug 09 02:41:46.912367 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Identity-Status: Confirmed Aug 09 02:41:46.912367 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Is-Admin-Project: True Aug 09 02:41:46.912367 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Domain-Id: default Aug 09 02:41:46.912367 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Domain-Name: Default Aug 09 02:41:46.912367 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Id: 88f96c9ae9b44b91a4db2187160a5688 Aug 09 02:41:46.912367 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Name: tempest-DeleteServersTestJSON-453863208 Aug 09 02:41:46.912367 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Role: reader,member Aug 09 02:41:46.912367 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Roles: reader,member Aug 09 02:41:46.913932 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/88f96c9ae9b44b91a4db2187160a5688"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/88f96c9ae9b44b91a4db2187160a5688"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_88f96c9ae9b44b91a4db2187160a5688"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/88f96c9ae9b44b91a4db2187160a5688"}]}] Aug 09 02:41:46.913932 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant: tempest-DeleteServersTestJSON-453863208 Aug 09 02:41:46.913932 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant-Id: 88f96c9ae9b44b91a4db2187160a5688 Aug 09 02:41:46.913932 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant-Name: tempest-DeleteServersTestJSON-453863208 Aug 09 02:41:46.913932 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User: tempest-DeleteServersTestJSON-453863208-project Aug 09 02:41:46.913932 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Domain-Id: default Aug 09 02:41:46.913932 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Domain-Name: Default Aug 09 02:41:46.913932 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Id: 113d48eb42524e62bfc95606f93f3736 Aug 09 02:41:46.913932 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Name: tempest-DeleteServersTestJSON-453863208-project Aug 09 02:41:46.913932 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: method: > Aug 09 02:41:46.913932 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: exception: Instance 1e614721-c888-4eaf-b834-42497e80345c could not be found. Aug 09 02:41:46.913932 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: action_args: {'server_id': '1e614721-c888-4eaf-b834-42497e80345c'} Aug 09 02:41:46.914750 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 02:41:46.914750 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:41:46.914750 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 02:41:46.914750 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 02:41:46.914750 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 02:41:46.914750 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 02:41:46.914750 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 02:41:46.914750 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 02:41:46.914750 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 02:41:46.914750 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 02:41:46.914750 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e614721-c888-4eaf-b834-42497e80345c could not be found. Aug 09 02:41:46.914750 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:41:46.914750 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:41:46.914750 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:41:46.914750 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:41:46.914750 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:41:46.914750 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:41:46.914750 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 02:41:46.914750 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 02:41:46.914750 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 02:41:46.916344 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 02:41:46.916344 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 09 02:41:46.916344 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 02:41:46.916344 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 09 02:41:46.916344 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 02:41:46.916344 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 09 02:41:46.916344 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 09 02:41:46.916344 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 02:41:46.916344 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 02:41:46.916344 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e614721-c888-4eaf-b834-42497e80345c could not be found. Aug 09 02:41:46.916344 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:41:46.916344 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:41:46.916344 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:41:46.916344 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:41:46.916344 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:41:46.916344 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:41:46.916344 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 02:41:46.916344 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 02:41:46.916344 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e614721-c888-4eaf-b834-42497e80345c could not be found. Aug 09 02:41:46.916344 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:41:46.917857 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-1f487d75-1d49-4a3a-9df0-2b31789624ee tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Returning 404 to user: Instance 1e614721-c888-4eaf-b834-42497e80345c could not be found. {{(pid=124427) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 02:41:46.919192 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-1f487d75-1d49-4a3a-9df0-2b31789624ee tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] 10.222.0.20 "GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.069419 Aug 09 02:41:46.920206 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 92/172] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 9 02:41:46 2022] GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c/os-volume_attachments => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 02:41:46.942991 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-4e5947c3-b4f0-4704-93a4-9d39f0f2466e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:46.943772 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-4e5947c3-b4f0-4704-93a4-9d39f0f2466e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:46.956680 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4e5947c3-b4f0-4704-93a4-9d39f0f2466e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:46.958727 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4e5947c3-b4f0-4704-93a4-9d39f0f2466e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:46.960580 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4e5947c3-b4f0-4704-93a4-9d39f0f2466e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:46.961302 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4e5947c3-b4f0-4704-93a4-9d39f0f2466e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:46.961763 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4e5947c3-b4f0-4704-93a4-9d39f0f2466e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:46.962295 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4e5947c3-b4f0-4704-93a4-9d39f0f2466e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:47.196826 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-4e5947c3-b4f0-4704-93a4-9d39f0f2466e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:47.206033 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-4e5947c3-b4f0-4704-93a4-9d39f0f2466e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507" status: 200 len: 1521 microversion: 2.1 time: 0.268860 Aug 09 02:41:47.208541 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 81/173] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:46 2022] GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507 => generated 1521 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:47.443056 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-685df4ab-cb70-4a86-8fd1-3a3aa16c203f tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:47.444310 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-685df4ab-cb70-4a86-8fd1-3a3aa16c203f tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] [instance: 49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:47.455619 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-685df4ab-cb70-4a86-8fd1-3a3aa16c203f tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:47.456114 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-685df4ab-cb70-4a86-8fd1-3a3aa16c203f tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:47.456542 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-685df4ab-cb70-4a86-8fd1-3a3aa16c203f tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:47.457238 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-685df4ab-cb70-4a86-8fd1-3a3aa16c203f tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:47.457686 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-685df4ab-cb70-4a86-8fd1-3a3aa16c203f tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:47.458098 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-685df4ab-cb70-4a86-8fd1-3a3aa16c203f tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:47.514648 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:41:47.686216 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-685df4ab-cb70-4a86-8fd1-3a3aa16c203f tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f584ae6eae48e994c19ae3786b95d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017a524b579e48d2bc6fe99ab8332456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:47.696552 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-685df4ab-cb70-4a86-8fd1-3a3aa16c203f tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] 10.222.0.20 "GET /compute/v2.1/servers/49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e" status: 200 len: 1313 microversion: 2.1 time: 0.257243 Aug 09 02:41:47.697137 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 93/174] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:47 2022] GET /compute/v2.1/servers/49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e => generated 1313 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:48.228396 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-1948f4c0-42eb-407c-875d-e3223a3871fc tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:48.229167 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-1948f4c0-42eb-407c-875d-e3223a3871fc tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:48.238352 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1948f4c0-42eb-407c-875d-e3223a3871fc tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:48.238845 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1948f4c0-42eb-407c-875d-e3223a3871fc tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:48.239213 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1948f4c0-42eb-407c-875d-e3223a3871fc tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:48.239932 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1948f4c0-42eb-407c-875d-e3223a3871fc tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:48.240377 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1948f4c0-42eb-407c-875d-e3223a3871fc tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:48.240788 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1948f4c0-42eb-407c-875d-e3223a3871fc tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:48.315299 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-87d7038d-92fd-408f-aec4-ea917efc22df tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:48.315798 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-87d7038d-92fd-408f-aec4-ea917efc22df tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] [instance: 1e614721-c888-4eaf-b834-42497e80345c] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:48.336303 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-87d7038d-92fd-408f-aec4-ea917efc22df tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:48.337037 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-87d7038d-92fd-408f-aec4-ea917efc22df tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:48.350318 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-87d7038d-92fd-408f-aec4-ea917efc22df tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:48.351080 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-87d7038d-92fd-408f-aec4-ea917efc22df tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:48.355240 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-87d7038d-92fd-408f-aec4-ea917efc22df tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:48.356339 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-87d7038d-92fd-408f-aec4-ea917efc22df tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:48.397253 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.wsgi [None req-87d7038d-92fd-408f-aec4-ea917efc22df tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] HTTP exception thrown: Instance 1e614721-c888-4eaf-b834-42497e80345c could not be found. Aug 09 02:41:48.400455 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-87d7038d-92fd-408f-aec4-ea917efc22df tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Request method failure captured: Aug 09 02:41:48.400455 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: request: DELETE /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c HTTP/1.1 Aug 09 02:41:48.400455 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Accept: application/json Aug 09 02:41:48.400455 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Accept-Encoding: identity Aug 09 02:41:48.400455 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Connection: close Aug 09 02:41:48.400455 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Content-Length: 0 Aug 09 02:41:48.400455 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Content-Type: application/json Aug 09 02:41:48.400455 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Host: 10.222.0.20 Aug 09 02:41:48.400455 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Openstack-System-Scope: None Aug 09 02:41:48.400455 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: User-Agent: python-urllib3/1.26.11 Aug 09 02:41:48.400455 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Auth-Token: gAAAAABi8ckaE9sW9m9XwJCDR7Vx1uQd-9b5RqrD40ywOYvxq8AhKWNoz8FWiqff0sgzX6u4A9pI6kM6mWjTkPP9fDyD3k0jQrlNTt4mNIeFyBZagbGOL0yZ1QWWonK23SQFVwFrCzwRX4b4GQAk69bXBW94lo4sP5-7gUhfuzDNhE4zSUVb1Bo Aug 09 02:41:48.400455 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Domain-Id: None Aug 09 02:41:48.400455 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Domain-Name: None Aug 09 02:41:48.400455 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Identity-Status: Confirmed Aug 09 02:41:48.400455 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Is-Admin-Project: True Aug 09 02:41:48.400455 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Domain-Id: default Aug 09 02:41:48.400455 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Domain-Name: Default Aug 09 02:41:48.400455 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Id: 88f96c9ae9b44b91a4db2187160a5688 Aug 09 02:41:48.400455 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Name: tempest-DeleteServersTestJSON-453863208 Aug 09 02:41:48.400455 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Role: reader,member Aug 09 02:41:48.400455 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Roles: reader,member Aug 09 02:41:48.401960 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/88f96c9ae9b44b91a4db2187160a5688"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/88f96c9ae9b44b91a4db2187160a5688"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_88f96c9ae9b44b91a4db2187160a5688"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/88f96c9ae9b44b91a4db2187160a5688"}]}] Aug 09 02:41:48.401960 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant: tempest-DeleteServersTestJSON-453863208 Aug 09 02:41:48.401960 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant-Id: 88f96c9ae9b44b91a4db2187160a5688 Aug 09 02:41:48.401960 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant-Name: tempest-DeleteServersTestJSON-453863208 Aug 09 02:41:48.401960 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User: tempest-DeleteServersTestJSON-453863208-project Aug 09 02:41:48.401960 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Domain-Id: default Aug 09 02:41:48.401960 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Domain-Name: Default Aug 09 02:41:48.401960 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Id: 113d48eb42524e62bfc95606f93f3736 Aug 09 02:41:48.401960 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Name: tempest-DeleteServersTestJSON-453863208-project Aug 09 02:41:48.401960 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: method: > Aug 09 02:41:48.401960 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: exception: Instance 1e614721-c888-4eaf-b834-42497e80345c could not be found. Aug 09 02:41:48.401960 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: action_args: {'id': '1e614721-c888-4eaf-b834-42497e80345c'} Aug 09 02:41:48.402826 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 02:41:48.402826 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:41:48.402826 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 02:41:48.402826 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 02:41:48.402826 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 02:41:48.402826 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 02:41:48.402826 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 02:41:48.402826 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 02:41:48.402826 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 02:41:48.402826 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 02:41:48.402826 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e614721-c888-4eaf-b834-42497e80345c could not be found. Aug 09 02:41:48.402826 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:41:48.402826 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:41:48.402826 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:41:48.402826 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:41:48.402826 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:41:48.402826 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:41:48.402826 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 02:41:48.402826 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 02:41:48.402826 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 02:41:48.404216 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 02:41:48.404216 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 02:41:48.404216 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 02:41:48.404216 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 02:41:48.404216 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 02:41:48.404216 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 02:41:48.404216 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 02:41:48.404216 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 02:41:48.404216 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 02:41:48.404216 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e614721-c888-4eaf-b834-42497e80345c could not be found. Aug 09 02:41:48.404216 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:41:48.404216 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:41:48.404216 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:41:48.404216 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:41:48.404216 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:41:48.404216 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:41:48.404216 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 02:41:48.404216 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 02:41:48.404216 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e614721-c888-4eaf-b834-42497e80345c could not be found. Aug 09 02:41:48.404216 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:41:48.410333 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-87d7038d-92fd-408f-aec4-ea917efc22df tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Returning 404 to user: Instance 1e614721-c888-4eaf-b834-42497e80345c could not be found. {{(pid=124427) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 02:41:48.411381 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-87d7038d-92fd-408f-aec4-ea917efc22df tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c" status: 404 len: 111 microversion: 2.1 time: 0.100035 Aug 09 02:41:48.413610 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 94/175] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 9 02:41:48 2022] DELETE /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 02:41:48.422891 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-2c072d40-5a15-49bc-8787-fb270d2fc7ae tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:48.427007 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-2c072d40-5a15-49bc-8787-fb270d2fc7ae tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] [instance: 1e614721-c888-4eaf-b834-42497e80345c] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:48.440180 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2c072d40-5a15-49bc-8787-fb270d2fc7ae tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:48.440851 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2c072d40-5a15-49bc-8787-fb270d2fc7ae tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:48.441586 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2c072d40-5a15-49bc-8787-fb270d2fc7ae tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:48.442497 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2c072d40-5a15-49bc-8787-fb270d2fc7ae tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:48.443101 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2c072d40-5a15-49bc-8787-fb270d2fc7ae tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:48.444276 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2c072d40-5a15-49bc-8787-fb270d2fc7ae tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:48.471377 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.wsgi [None req-2c072d40-5a15-49bc-8787-fb270d2fc7ae tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] HTTP exception thrown: Instance 1e614721-c888-4eaf-b834-42497e80345c could not be found. Aug 09 02:41:48.473733 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-2c072d40-5a15-49bc-8787-fb270d2fc7ae tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Request method failure captured: Aug 09 02:41:48.473733 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: request: GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c HTTP/1.1 Aug 09 02:41:48.473733 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Accept: application/json Aug 09 02:41:48.473733 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Accept-Encoding: identity Aug 09 02:41:48.473733 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Connection: close Aug 09 02:41:48.473733 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Content-Length: 0 Aug 09 02:41:48.473733 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Content-Type: application/json Aug 09 02:41:48.473733 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Host: 10.222.0.20 Aug 09 02:41:48.473733 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Openstack-System-Scope: None Aug 09 02:41:48.473733 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: User-Agent: python-urllib3/1.26.11 Aug 09 02:41:48.473733 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Auth-Token: gAAAAABi8ckaE9sW9m9XwJCDR7Vx1uQd-9b5RqrD40ywOYvxq8AhKWNoz8FWiqff0sgzX6u4A9pI6kM6mWjTkPP9fDyD3k0jQrlNTt4mNIeFyBZagbGOL0yZ1QWWonK23SQFVwFrCzwRX4b4GQAk69bXBW94lo4sP5-7gUhfuzDNhE4zSUVb1Bo Aug 09 02:41:48.473733 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Domain-Id: None Aug 09 02:41:48.473733 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Domain-Name: None Aug 09 02:41:48.473733 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Identity-Status: Confirmed Aug 09 02:41:48.473733 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Is-Admin-Project: True Aug 09 02:41:48.473733 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Domain-Id: default Aug 09 02:41:48.473733 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Domain-Name: Default Aug 09 02:41:48.473733 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Id: 88f96c9ae9b44b91a4db2187160a5688 Aug 09 02:41:48.473733 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Name: tempest-DeleteServersTestJSON-453863208 Aug 09 02:41:48.473733 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Role: reader,member Aug 09 02:41:48.473733 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Roles: reader,member Aug 09 02:41:48.475136 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/88f96c9ae9b44b91a4db2187160a5688"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/88f96c9ae9b44b91a4db2187160a5688"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_88f96c9ae9b44b91a4db2187160a5688"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/88f96c9ae9b44b91a4db2187160a5688"}]}] Aug 09 02:41:48.475136 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant: tempest-DeleteServersTestJSON-453863208 Aug 09 02:41:48.475136 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant-Id: 88f96c9ae9b44b91a4db2187160a5688 Aug 09 02:41:48.475136 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant-Name: tempest-DeleteServersTestJSON-453863208 Aug 09 02:41:48.475136 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User: tempest-DeleteServersTestJSON-453863208-project Aug 09 02:41:48.475136 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Domain-Id: default Aug 09 02:41:48.475136 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Domain-Name: Default Aug 09 02:41:48.475136 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Id: 113d48eb42524e62bfc95606f93f3736 Aug 09 02:41:48.475136 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Name: tempest-DeleteServersTestJSON-453863208-project Aug 09 02:41:48.475136 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: method: > Aug 09 02:41:48.475136 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: exception: Instance 1e614721-c888-4eaf-b834-42497e80345c could not be found. Aug 09 02:41:48.475136 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: action_args: {'id': '1e614721-c888-4eaf-b834-42497e80345c'} Aug 09 02:41:48.475930 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 02:41:48.475930 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:41:48.475930 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 02:41:48.475930 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 02:41:48.475930 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 02:41:48.475930 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 02:41:48.475930 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 02:41:48.475930 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 02:41:48.475930 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 02:41:48.475930 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 02:41:48.475930 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e614721-c888-4eaf-b834-42497e80345c could not be found. Aug 09 02:41:48.475930 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:41:48.475930 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:41:48.475930 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:41:48.475930 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:41:48.475930 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:41:48.475930 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:41:48.475930 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 02:41:48.475930 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 02:41:48.475930 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 02:41:48.477156 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 02:41:48.477156 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 02:41:48.477156 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 02:41:48.477156 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 02:41:48.477156 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 02:41:48.477156 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 02:41:48.477156 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 02:41:48.477156 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e614721-c888-4eaf-b834-42497e80345c could not be found. Aug 09 02:41:48.477156 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:41:48.477156 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:41:48.477156 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:41:48.477156 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:41:48.477156 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:41:48.477156 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:41:48.477156 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 02:41:48.477156 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 02:41:48.477156 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e614721-c888-4eaf-b834-42497e80345c could not be found. Aug 09 02:41:48.477156 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:41:48.479128 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-2c072d40-5a15-49bc-8787-fb270d2fc7ae tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] Returning 404 to user: Instance 1e614721-c888-4eaf-b834-42497e80345c could not be found. {{(pid=124427) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 02:41:48.481358 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-2c072d40-5a15-49bc-8787-fb270d2fc7ae tempest-DeleteServersTestJSON-453863208 tempest-DeleteServersTestJSON-453863208-project] 10.222.0.20 "GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c" status: 404 len: 111 microversion: 2.1 time: 0.061579 Aug 09 02:41:48.482398 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 95/176] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:48 2022] GET /compute/v2.1/servers/1e614721-c888-4eaf-b834-42497e80345c => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 02:41:48.582190 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-1948f4c0-42eb-407c-875d-e3223a3871fc tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:48.606037 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-1948f4c0-42eb-407c-875d-e3223a3871fc tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507" status: 200 len: 1521 microversion: 2.1 time: 0.382219 Aug 09 02:41:48.608971 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 82/177] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:48 2022] GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507 => generated 1521 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:48.648225 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [req-0611886c-7063-43f1-8923-f1c850899b71 req-9ac19894-bf24-4c58-bd29-b779a74ec15e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e", "name": "network-vif-plugged", "status": "completed", "tag": "a682b349-80c7-44e8-838b-efa10e67c865"}]} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:41:48.666454 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-0611886c-7063-43f1-8923-f1c850899b71 req-9ac19894-bf24-4c58-bd29-b779a74ec15e service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:48.670101 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-0611886c-7063-43f1-8923-f1c850899b71 req-9ac19894-bf24-4c58-bd29-b779a74ec15e service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:48.672794 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-0611886c-7063-43f1-8923-f1c850899b71 req-9ac19894-bf24-4c58-bd29-b779a74ec15e service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:48.702827 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.compute.server_external_events [req-0611886c-7063-43f1-8923-f1c850899b71 req-9ac19894-bf24-4c58-bd29-b779a74ec15e service nova] Creating event network-vif-plugged:a682b349-80c7-44e8-838b-efa10e67c865 for instance 49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e on hv-cinder-85246 Aug 09 02:41:48.720428 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-35e4dd5f-1965-4e37-92af-08d94a0d5ef2 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:48.722242 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-35e4dd5f-1965-4e37-92af-08d94a0d5ef2 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] [instance: 49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:48.732607 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [req-0611886c-7063-43f1-8923-f1c850899b71 req-9ac19894-bf24-4c58-bd29-b779a74ec15e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089303 Aug 09 02:41:48.734080 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 96/178] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:41:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:41:48.737395 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-35e4dd5f-1965-4e37-92af-08d94a0d5ef2 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:48.739258 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-35e4dd5f-1965-4e37-92af-08d94a0d5ef2 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:48.740443 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-35e4dd5f-1965-4e37-92af-08d94a0d5ef2 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:48.744679 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-35e4dd5f-1965-4e37-92af-08d94a0d5ef2 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:48.746802 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-35e4dd5f-1965-4e37-92af-08d94a0d5ef2 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:48.748208 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-35e4dd5f-1965-4e37-92af-08d94a0d5ef2 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:49.190733 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-35e4dd5f-1965-4e37-92af-08d94a0d5ef2 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f584ae6eae48e994c19ae3786b95d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017a524b579e48d2bc6fe99ab8332456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:49.199885 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-35e4dd5f-1965-4e37-92af-08d94a0d5ef2 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] 10.222.0.20 "GET /compute/v2.1/servers/49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e" status: 200 len: 1313 microversion: 2.1 time: 0.484773 Aug 09 02:41:49.200477 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 83/179] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:48 2022] GET /compute/v2.1/servers/49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e => generated 1313 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:49.630109 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-1730afb4-f0f0-4ea5-8e9b-cc36cad62cb0 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:49.630881 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-1730afb4-f0f0-4ea5-8e9b-cc36cad62cb0 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:49.642886 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1730afb4-f0f0-4ea5-8e9b-cc36cad62cb0 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:49.643652 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1730afb4-f0f0-4ea5-8e9b-cc36cad62cb0 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:49.644468 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1730afb4-f0f0-4ea5-8e9b-cc36cad62cb0 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:49.645372 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1730afb4-f0f0-4ea5-8e9b-cc36cad62cb0 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:49.646018 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1730afb4-f0f0-4ea5-8e9b-cc36cad62cb0 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:49.646647 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1730afb4-f0f0-4ea5-8e9b-cc36cad62cb0 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:49.972147 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-1730afb4-f0f0-4ea5-8e9b-cc36cad62cb0 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:49.981437 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-1730afb4-f0f0-4ea5-8e9b-cc36cad62cb0 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507" status: 200 len: 1521 microversion: 2.1 time: 0.355433 Aug 09 02:41:49.982019 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 97/180] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:49 2022] GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507 => generated 1521 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:50.223082 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-af66887b-41c8-47ee-9da8-80224147e969 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:50.224342 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-af66887b-41c8-47ee-9da8-80224147e969 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] [instance: 49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:50.237730 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-af66887b-41c8-47ee-9da8-80224147e969 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:50.239088 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-af66887b-41c8-47ee-9da8-80224147e969 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:50.240427 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-af66887b-41c8-47ee-9da8-80224147e969 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:50.244169 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-af66887b-41c8-47ee-9da8-80224147e969 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:50.246955 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-af66887b-41c8-47ee-9da8-80224147e969 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:50.247766 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-af66887b-41c8-47ee-9da8-80224147e969 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:50.526038 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-af66887b-41c8-47ee-9da8-80224147e969 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f584ae6eae48e994c19ae3786b95d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017a524b579e48d2bc6fe99ab8332456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:50.538073 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-af66887b-41c8-47ee-9da8-80224147e969 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] 10.222.0.20 "GET /compute/v2.1/servers/49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e" status: 200 len: 1313 microversion: 2.1 time: 0.318457 Aug 09 02:41:50.539261 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 84/181] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:50 2022] GET /compute/v2.1/servers/49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e => generated 1313 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:51.007882 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-87049319-ed18-4284-89f3-09ed4d23a481 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:51.008506 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-87049319-ed18-4284-89f3-09ed4d23a481 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:51.027523 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-87049319-ed18-4284-89f3-09ed4d23a481 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:51.029393 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-87049319-ed18-4284-89f3-09ed4d23a481 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:51.030054 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-87049319-ed18-4284-89f3-09ed4d23a481 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:51.031072 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-87049319-ed18-4284-89f3-09ed4d23a481 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:51.032260 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-87049319-ed18-4284-89f3-09ed4d23a481 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:51.034640 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-87049319-ed18-4284-89f3-09ed4d23a481 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:51.320264 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-87049319-ed18-4284-89f3-09ed4d23a481 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:51.329602 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-87049319-ed18-4284-89f3-09ed4d23a481 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507" status: 200 len: 1521 microversion: 2.1 time: 0.328510 Aug 09 02:41:51.333694 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 98/182] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:50 2022] GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507 => generated 1521 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:51.562096 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-a3e8b900-1d1e-4e26-a551-d70b7af21f0c tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:51.563498 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-a3e8b900-1d1e-4e26-a551-d70b7af21f0c tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] [instance: 49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:51.571112 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a3e8b900-1d1e-4e26-a551-d70b7af21f0c tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:51.577816 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a3e8b900-1d1e-4e26-a551-d70b7af21f0c tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:51.578290 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a3e8b900-1d1e-4e26-a551-d70b7af21f0c tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:51.579023 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a3e8b900-1d1e-4e26-a551-d70b7af21f0c tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:51.579485 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a3e8b900-1d1e-4e26-a551-d70b7af21f0c tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:51.579882 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a3e8b900-1d1e-4e26-a551-d70b7af21f0c tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:52.358121 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-738ab5c8-365a-410e-a821-fbb7b7248c19 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:52.359009 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-738ab5c8-365a-410e-a821-fbb7b7248c19 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:52.362292 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-a3e8b900-1d1e-4e26-a551-d70b7af21f0c tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f584ae6eae48e994c19ae3786b95d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017a524b579e48d2bc6fe99ab8332456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:52.371398 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-a3e8b900-1d1e-4e26-a551-d70b7af21f0c tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] 10.222.0.20 "GET /compute/v2.1/servers/49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e" status: 200 len: 1313 microversion: 2.1 time: 0.813333 Aug 09 02:41:52.373257 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-738ab5c8-365a-410e-a821-fbb7b7248c19 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:52.373761 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-738ab5c8-365a-410e-a821-fbb7b7248c19 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:52.374216 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-738ab5c8-365a-410e-a821-fbb7b7248c19 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:52.374931 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-738ab5c8-365a-410e-a821-fbb7b7248c19 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:52.375375 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-738ab5c8-365a-410e-a821-fbb7b7248c19 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:52.375498 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 85/183] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:51 2022] GET /compute/v2.1/servers/49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e => generated 1313 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:52.375784 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-738ab5c8-365a-410e-a821-fbb7b7248c19 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:52.643579 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-738ab5c8-365a-410e-a821-fbb7b7248c19 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:52.656441 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-738ab5c8-365a-410e-a821-fbb7b7248c19 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507" status: 200 len: 1521 microversion: 2.1 time: 0.302572 Aug 09 02:41:52.672631 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 99/184] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:52 2022] GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507 => generated 1521 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:53.398244 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-63850c39-dc5e-476e-a919-86b0b38ff388 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:53.399149 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-63850c39-dc5e-476e-a919-86b0b38ff388 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] [instance: 49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:53.409009 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-63850c39-dc5e-476e-a919-86b0b38ff388 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:53.412244 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-63850c39-dc5e-476e-a919-86b0b38ff388 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:53.412852 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-63850c39-dc5e-476e-a919-86b0b38ff388 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:53.413591 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-63850c39-dc5e-476e-a919-86b0b38ff388 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:53.414039 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-63850c39-dc5e-476e-a919-86b0b38ff388 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:53.414520 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-63850c39-dc5e-476e-a919-86b0b38ff388 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:53.676611 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-63850c39-dc5e-476e-a919-86b0b38ff388 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f584ae6eae48e994c19ae3786b95d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017a524b579e48d2bc6fe99ab8332456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:53.682492 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-66514d55-5ff8-4244-9cba-35dc13ce65ec tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:53.683661 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-66514d55-5ff8-4244-9cba-35dc13ce65ec tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:53.695334 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:41:53.701576 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-66514d55-5ff8-4244-9cba-35dc13ce65ec tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:53.702690 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-66514d55-5ff8-4244-9cba-35dc13ce65ec tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:53.703289 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-66514d55-5ff8-4244-9cba-35dc13ce65ec tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:53.704158 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-66514d55-5ff8-4244-9cba-35dc13ce65ec tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:53.704779 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-66514d55-5ff8-4244-9cba-35dc13ce65ec tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:53.711357 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-66514d55-5ff8-4244-9cba-35dc13ce65ec tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:53.713859 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-63850c39-dc5e-476e-a919-86b0b38ff388 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] 10.222.0.20 "GET /compute/v2.1/servers/49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e" status: 200 len: 1313 microversion: 2.1 time: 0.323505 Aug 09 02:41:53.722423 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 86/185] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:53 2022] GET /compute/v2.1/servers/49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e => generated 1313 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:54.116073 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-66514d55-5ff8-4244-9cba-35dc13ce65ec tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:54.124742 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-66514d55-5ff8-4244-9cba-35dc13ce65ec tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507" status: 200 len: 1521 microversion: 2.1 time: 0.446669 Aug 09 02:41:54.127702 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 100/186] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:53 2022] GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507 => generated 1521 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:41:54.742320 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-15168f33-5bb4-4a7c-babf-0da1fb83d1fd tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:54.744075 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-15168f33-5bb4-4a7c-babf-0da1fb83d1fd tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] [instance: 49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:54.753120 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-15168f33-5bb4-4a7c-babf-0da1fb83d1fd tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:54.754073 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-15168f33-5bb4-4a7c-babf-0da1fb83d1fd tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:54.754867 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-15168f33-5bb4-4a7c-babf-0da1fb83d1fd tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:54.756502 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-15168f33-5bb4-4a7c-babf-0da1fb83d1fd tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:54.758546 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-15168f33-5bb4-4a7c-babf-0da1fb83d1fd tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:54.759787 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-15168f33-5bb4-4a7c-babf-0da1fb83d1fd tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:55.010943 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-15168f33-5bb4-4a7c-babf-0da1fb83d1fd tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f584ae6eae48e994c19ae3786b95d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017a524b579e48d2bc6fe99ab8332456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:55.019561 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-15168f33-5bb4-4a7c-babf-0da1fb83d1fd tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] 10.222.0.20 "GET /compute/v2.1/servers/49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e" status: 200 len: 1462 microversion: 2.1 time: 0.282691 Aug 09 02:41:55.030972 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 87/187] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:54 2022] GET /compute/v2.1/servers/49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e => generated 1462 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:55.075502 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-9670b2e9-beb2-4426-865b-aa14c67938ed tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:55.076747 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-9670b2e9-beb2-4426-865b-aa14c67938ed tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] [instance: 49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:55.114793 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9670b2e9-beb2-4426-865b-aa14c67938ed tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:55.115540 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9670b2e9-beb2-4426-865b-aa14c67938ed tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:55.117273 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9670b2e9-beb2-4426-865b-aa14c67938ed tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:55.120054 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9670b2e9-beb2-4426-865b-aa14c67938ed tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:55.120715 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9670b2e9-beb2-4426-865b-aa14c67938ed tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:55.121318 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9670b2e9-beb2-4426-865b-aa14c67938ed tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:55.156949 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-c010cbcd-3d77-4ebd-9e00-d53cbe0be8fe tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:55.157570 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-c010cbcd-3d77-4ebd-9e00-d53cbe0be8fe tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:55.170533 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c010cbcd-3d77-4ebd-9e00-d53cbe0be8fe tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:55.171237 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c010cbcd-3d77-4ebd-9e00-d53cbe0be8fe tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:55.172749 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c010cbcd-3d77-4ebd-9e00-d53cbe0be8fe tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:55.174620 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c010cbcd-3d77-4ebd-9e00-d53cbe0be8fe tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:55.175073 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c010cbcd-3d77-4ebd-9e00-d53cbe0be8fe tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:55.175491 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c010cbcd-3d77-4ebd-9e00-d53cbe0be8fe tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:55.181792 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-9670b2e9-beb2-4426-865b-aa14c67938ed tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] [instance: 49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e] Going to try to terminate instance {{(pid=124427) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 02:41:55.343235 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-9670b2e9-beb2-4426-865b-aa14c67938ed tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] 10.222.0.20 "DELETE /compute/v2.1/servers/49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e" status: 204 len: 0 microversion: 2.1 time: 0.271241 Aug 09 02:41:55.344153 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 101/188] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 9 02:41:55 2022] DELETE /compute/v2.1/servers/49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 02:41:55.357784 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-b38bf5a2-e8a8-4c5d-a35c-b83f8bfd7e8d tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:55.358867 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-b38bf5a2-e8a8-4c5d-a35c-b83f8bfd7e8d tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] [instance: 49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:55.370537 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b38bf5a2-e8a8-4c5d-a35c-b83f8bfd7e8d tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:55.371046 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b38bf5a2-e8a8-4c5d-a35c-b83f8bfd7e8d tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:55.371530 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b38bf5a2-e8a8-4c5d-a35c-b83f8bfd7e8d tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:55.372365 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b38bf5a2-e8a8-4c5d-a35c-b83f8bfd7e8d tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:55.372950 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b38bf5a2-e8a8-4c5d-a35c-b83f8bfd7e8d tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:55.373382 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b38bf5a2-e8a8-4c5d-a35c-b83f8bfd7e8d tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:55.505354 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-c010cbcd-3d77-4ebd-9e00-d53cbe0be8fe tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:55.524478 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-c010cbcd-3d77-4ebd-9e00-d53cbe0be8fe tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507" status: 200 len: 1521 microversion: 2.1 time: 0.371176 Aug 09 02:41:55.536209 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 88/189] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:55 2022] GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507 => generated 1521 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:41:55.618337 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-b38bf5a2-e8a8-4c5d-a35c-b83f8bfd7e8d tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f584ae6eae48e994c19ae3786b95d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017a524b579e48d2bc6fe99ab8332456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:55.631272 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-b38bf5a2-e8a8-4c5d-a35c-b83f8bfd7e8d tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] 10.222.0.20 "GET /compute/v2.1/servers/49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e" status: 200 len: 1468 microversion: 2.1 time: 0.279227 Aug 09 02:41:55.631865 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 102/190] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:55 2022] GET /compute/v2.1/servers/49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e => generated 1468 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:56.552936 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-6924f62d-8868-4e8e-ad0c-3d9ccb872ad6 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:56.553543 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-6924f62d-8868-4e8e-ad0c-3d9ccb872ad6 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:56.560202 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6924f62d-8868-4e8e-ad0c-3d9ccb872ad6 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:56.569615 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6924f62d-8868-4e8e-ad0c-3d9ccb872ad6 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:56.571243 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6924f62d-8868-4e8e-ad0c-3d9ccb872ad6 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:56.571243 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6924f62d-8868-4e8e-ad0c-3d9ccb872ad6 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:56.572217 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6924f62d-8868-4e8e-ad0c-3d9ccb872ad6 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:56.573360 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6924f62d-8868-4e8e-ad0c-3d9ccb872ad6 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:56.653746 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-2389ecda-6987-48b9-a473-743c307de4ac tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:56.655016 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-2389ecda-6987-48b9-a473-743c307de4ac tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] [instance: 49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:56.665484 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2389ecda-6987-48b9-a473-743c307de4ac tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:56.666302 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2389ecda-6987-48b9-a473-743c307de4ac tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:56.670767 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2389ecda-6987-48b9-a473-743c307de4ac tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:56.672483 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2389ecda-6987-48b9-a473-743c307de4ac tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:56.673147 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2389ecda-6987-48b9-a473-743c307de4ac tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:56.673778 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2389ecda-6987-48b9-a473-743c307de4ac tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:56.830948 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-6924f62d-8868-4e8e-ad0c-3d9ccb872ad6 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:56.839248 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-6924f62d-8868-4e8e-ad0c-3d9ccb872ad6 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507" status: 200 len: 1521 microversion: 2.1 time: 0.290079 Aug 09 02:41:56.839828 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 89/191] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:56 2022] GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507 => generated 1521 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:56.935247 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-2389ecda-6987-48b9-a473-743c307de4ac tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f584ae6eae48e994c19ae3786b95d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017a524b579e48d2bc6fe99ab8332456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:56.944359 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-2389ecda-6987-48b9-a473-743c307de4ac tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] 10.222.0.20 "GET /compute/v2.1/servers/49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e" status: 200 len: 1468 microversion: 2.1 time: 0.295465 Aug 09 02:41:56.945550 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 103/192] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:56 2022] GET /compute/v2.1/servers/49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e => generated 1468 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:41:57.864111 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-cda81f3f-f4d6-411a-871f-a4a8fe8307bf tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:57.865452 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-cda81f3f-f4d6-411a-871f-a4a8fe8307bf tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:57.874618 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-cda81f3f-f4d6-411a-871f-a4a8fe8307bf tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:57.875854 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-cda81f3f-f4d6-411a-871f-a4a8fe8307bf tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:57.876532 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-cda81f3f-f4d6-411a-871f-a4a8fe8307bf tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:57.883115 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-cda81f3f-f4d6-411a-871f-a4a8fe8307bf tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:57.884110 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-cda81f3f-f4d6-411a-871f-a4a8fe8307bf tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:57.884786 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-cda81f3f-f4d6-411a-871f-a4a8fe8307bf tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:57.902119 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_cell1:SELECT=100 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:41:57.975017 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-e9dca083-0817-417f-8dfc-523a506e787e tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:57.976755 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-e9dca083-0817-417f-8dfc-523a506e787e tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] [instance: 49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:57.984383 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e9dca083-0817-417f-8dfc-523a506e787e tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:57.984790 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e9dca083-0817-417f-8dfc-523a506e787e tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:57.985235 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e9dca083-0817-417f-8dfc-523a506e787e tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:57.985943 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e9dca083-0817-417f-8dfc-523a506e787e tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:57.986583 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e9dca083-0817-417f-8dfc-523a506e787e tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:57.987174 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e9dca083-0817-417f-8dfc-523a506e787e tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:58.385516 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-cda81f3f-f4d6-411a-871f-a4a8fe8307bf tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:58.396600 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-cda81f3f-f4d6-411a-871f-a4a8fe8307bf tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507" status: 200 len: 1521 microversion: 2.1 time: 0.537143 Aug 09 02:41:58.399491 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 90/193] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:57 2022] GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507 => generated 1521 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:58.553225 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [req-20bf0286-2a8f-4189-8efb-5f3508a087df req-f5399015-d029-49d4-85bf-e41293da6d55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e", "name": "network-vif-deleted", "tag": "a682b349-80c7-44e8-838b-efa10e67c865"}]} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:41:58.585205 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-20bf0286-2a8f-4189-8efb-5f3508a087df req-f5399015-d029-49d4-85bf-e41293da6d55 service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:58.585752 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-20bf0286-2a8f-4189-8efb-5f3508a087df req-f5399015-d029-49d4-85bf-e41293da6d55 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:58.586277 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-20bf0286-2a8f-4189-8efb-5f3508a087df req-f5399015-d029-49d4-85bf-e41293da6d55 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:58.623200 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-e9dca083-0817-417f-8dfc-523a506e787e tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f584ae6eae48e994c19ae3786b95d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017a524b579e48d2bc6fe99ab8332456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:58.640521 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-e9dca083-0817-417f-8dfc-523a506e787e tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] 10.222.0.20 "GET /compute/v2.1/servers/49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e" status: 200 len: 1468 microversion: 2.1 time: 0.662555 Aug 09 02:41:58.645247 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 104/194] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:57 2022] GET /compute/v2.1/servers/49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e => generated 1468 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:58.655840 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.compute.server_external_events [req-20bf0286-2a8f-4189-8efb-5f3508a087df req-f5399015-d029-49d4-85bf-e41293da6d55 service nova] Creating event network-vif-deleted:a682b349-80c7-44e8-838b-efa10e67c865 for instance 49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e on hv-cinder-85246 Aug 09 02:41:58.677186 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [req-20bf0286-2a8f-4189-8efb-5f3508a087df req-f5399015-d029-49d4-85bf-e41293da6d55 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128685 Aug 09 02:41:58.682929 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 91/195] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:41:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 02:41:59.424335 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-b99d7820-82ad-4e14-810e-045888a5636d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:59.425544 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-b99d7820-82ad-4e14-810e-045888a5636d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:59.439094 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b99d7820-82ad-4e14-810e-045888a5636d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:59.439761 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b99d7820-82ad-4e14-810e-045888a5636d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:59.440303 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b99d7820-82ad-4e14-810e-045888a5636d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:59.441495 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b99d7820-82ad-4e14-810e-045888a5636d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:59.442338 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b99d7820-82ad-4e14-810e-045888a5636d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:59.443042 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b99d7820-82ad-4e14-810e-045888a5636d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:59.667621 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-24c3f709-fa1e-48d5-a47d-efe1d2875384 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:41:59.668387 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-24c3f709-fa1e-48d5-a47d-efe1d2875384 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] [instance: 49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:41:59.700946 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_api:SELECT=72 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:41:59.703360 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-24c3f709-fa1e-48d5-a47d-efe1d2875384 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:59.703986 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-24c3f709-fa1e-48d5-a47d-efe1d2875384 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:59.704406 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-24c3f709-fa1e-48d5-a47d-efe1d2875384 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:59.705223 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-24c3f709-fa1e-48d5-a47d-efe1d2875384 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:41:59.710947 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-24c3f709-fa1e-48d5-a47d-efe1d2875384 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:41:59.711923 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-24c3f709-fa1e-48d5-a47d-efe1d2875384 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:41:59.717541 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-b99d7820-82ad-4e14-810e-045888a5636d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:41:59.725410 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-b99d7820-82ad-4e14-810e-045888a5636d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507" status: 200 len: 1521 microversion: 2.1 time: 0.305123 Aug 09 02:41:59.725994 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 105/196] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:59 2022] GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507 => generated 1521 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:41:59.783111 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.wsgi [None req-24c3f709-fa1e-48d5-a47d-efe1d2875384 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] HTTP exception thrown: Instance 49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e could not be found. Aug 09 02:41:59.786563 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-24c3f709-fa1e-48d5-a47d-efe1d2875384 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Request method failure captured: Aug 09 02:41:59.786563 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: request: GET /compute/v2.1/servers/49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e HTTP/1.1 Aug 09 02:41:59.786563 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Accept: application/json Aug 09 02:41:59.786563 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Accept-Encoding: identity Aug 09 02:41:59.786563 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Connection: close Aug 09 02:41:59.786563 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Content-Length: 0 Aug 09 02:41:59.786563 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Content-Type: application/json Aug 09 02:41:59.786563 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Host: 10.222.0.20 Aug 09 02:41:59.786563 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Openstack-System-Scope: None Aug 09 02:41:59.786563 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: User-Agent: python-urllib3/1.26.11 Aug 09 02:41:59.786563 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Auth-Token: gAAAAABi8clLQ9scFTgIe1ZvVEyXExQWSlNZT4vZR-_pQIEXLbStil2SIEmhx_xtzVwHU4NJTbgUH25_L6VOcntGZHzb9reMk9bIqED-UD5AzvSKntE7JJnf0ZX1vX_oQbwb3rKBXCXnzUq2uHQYsc4v7txsCEvDOIxTLoTwBf5zLqvkyAA-v00 Aug 09 02:41:59.786563 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Domain-Id: None Aug 09 02:41:59.786563 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Domain-Name: None Aug 09 02:41:59.786563 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Identity-Status: Confirmed Aug 09 02:41:59.786563 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Is-Admin-Project: True Aug 09 02:41:59.786563 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Domain-Id: default Aug 09 02:41:59.786563 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Domain-Name: Default Aug 09 02:41:59.786563 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Id: 017a524b579e48d2bc6fe99ab8332456 Aug 09 02:41:59.786563 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Name: tempest-VolumesNegativeTest-876121579 Aug 09 02:41:59.786563 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Role: reader,member Aug 09 02:41:59.786563 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Roles: reader,member Aug 09 02:41:59.788036 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/017a524b579e48d2bc6fe99ab8332456"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/017a524b579e48d2bc6fe99ab8332456"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_017a524b579e48d2bc6fe99ab8332456"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/017a524b579e48d2bc6fe99ab8332456"}]}] Aug 09 02:41:59.788036 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant: tempest-VolumesNegativeTest-876121579 Aug 09 02:41:59.788036 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant-Id: 017a524b579e48d2bc6fe99ab8332456 Aug 09 02:41:59.788036 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant-Name: tempest-VolumesNegativeTest-876121579 Aug 09 02:41:59.788036 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User: tempest-VolumesNegativeTest-876121579-project Aug 09 02:41:59.788036 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Domain-Id: default Aug 09 02:41:59.788036 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Domain-Name: Default Aug 09 02:41:59.788036 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Id: 33f584ae6eae48e994c19ae3786b95d4 Aug 09 02:41:59.788036 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Name: tempest-VolumesNegativeTest-876121579-project Aug 09 02:41:59.788036 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: method: > Aug 09 02:41:59.788036 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: exception: Instance 49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e could not be found. Aug 09 02:41:59.788036 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: action_args: {'id': '49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e'} Aug 09 02:41:59.788921 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 02:41:59.788921 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:41:59.788921 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 02:41:59.788921 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 02:41:59.788921 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 02:41:59.788921 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 02:41:59.788921 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 02:41:59.788921 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 02:41:59.788921 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 02:41:59.788921 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 02:41:59.788921 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e could not be found. Aug 09 02:41:59.788921 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:41:59.788921 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:41:59.788921 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:41:59.788921 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:41:59.788921 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:41:59.788921 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:41:59.788921 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 02:41:59.788921 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 02:41:59.788921 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 02:41:59.790578 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 02:41:59.790578 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 02:41:59.790578 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 02:41:59.790578 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 02:41:59.790578 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 02:41:59.790578 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 02:41:59.790578 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 02:41:59.790578 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e could not be found. Aug 09 02:41:59.790578 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:41:59.790578 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:41:59.790578 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:41:59.790578 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:41:59.790578 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:41:59.790578 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:41:59.790578 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 02:41:59.790578 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 02:41:59.790578 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e could not be found. Aug 09 02:41:59.790578 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:41:59.791949 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-24c3f709-fa1e-48d5-a47d-efe1d2875384 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] Returning 404 to user: Instance 49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e could not be found. {{(pid=124425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 02:41:59.791949 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-24c3f709-fa1e-48d5-a47d-efe1d2875384 tempest-VolumesNegativeTest-876121579 tempest-VolumesNegativeTest-876121579-project] 10.222.0.20 "GET /compute/v2.1/servers/49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e" status: 404 len: 111 microversion: 2.1 time: 0.125845 Aug 09 02:41:59.793344 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 92/197] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:41:59 2022] GET /compute/v2.1/servers/49aa2f4d-5644-4dd8-aa85-0e4b2b3f9e4e => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 02:42:00.751890 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-00f3f278-cb81-4534-bf80-76fbb5ec872b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:00.752430 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-00f3f278-cb81-4534-bf80-76fbb5ec872b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:00.771976 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-00f3f278-cb81-4534-bf80-76fbb5ec872b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:00.772483 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-00f3f278-cb81-4534-bf80-76fbb5ec872b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:00.772917 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-00f3f278-cb81-4534-bf80-76fbb5ec872b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:00.773813 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-00f3f278-cb81-4534-bf80-76fbb5ec872b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:00.774515 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-00f3f278-cb81-4534-bf80-76fbb5ec872b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:00.775095 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-00f3f278-cb81-4534-bf80-76fbb5ec872b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:00.994402 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-00f3f278-cb81-4534-bf80-76fbb5ec872b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:01.004244 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-00f3f278-cb81-4534-bf80-76fbb5ec872b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507" status: 200 len: 1521 microversion: 2.1 time: 0.256360 Aug 09 02:42:01.005676 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 106/198] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:00 2022] GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507 => generated 1521 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:02.029880 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-3483cdc0-5c2c-4a4b-8dea-d2f6441374b1 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:02.032445 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-3483cdc0-5c2c-4a4b-8dea-d2f6441374b1 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:02.042312 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3483cdc0-5c2c-4a4b-8dea-d2f6441374b1 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:02.044767 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3483cdc0-5c2c-4a4b-8dea-d2f6441374b1 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:02.045716 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3483cdc0-5c2c-4a4b-8dea-d2f6441374b1 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:02.047601 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3483cdc0-5c2c-4a4b-8dea-d2f6441374b1 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:02.049099 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3483cdc0-5c2c-4a4b-8dea-d2f6441374b1 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:02.050271 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3483cdc0-5c2c-4a4b-8dea-d2f6441374b1 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:02.202804 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-6e74b85d-a48f-4f0e-af20-5475c658ca02 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Action: 'create', calling method: .version_select at 0x7fb0a061ed30>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-523919105", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKUDPZqrM17r2bkG8wZQzpgDZNOOobw1Ys1hdkl/+FujcZKmD5utRGTxddOAHhMygVkqX/3R0QGVXmuDZfGsCKnqP1OIvf92n6o85sYcAwGa/jLhUMrxIYvwAnW6WGAWfw=="}} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:42:02.234137 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.quota [None req-6e74b85d-a48f-4f0e-af20-5475c658ca02 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Getting quotas for project f0a5508bdf5e4577b49783c3e424f1ee. Resources: {'key_pairs'} {{(pid=124427) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 02:42:02.244649 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.quota [None req-6e74b85d-a48f-4f0e-af20-5475c658ca02 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Getting quotas for user f6d6b64eb434414ab61f19b170385c3d and project f0a5508bdf5e4577b49783c3e424f1ee. Resources: {'key_pairs'} {{(pid=124427) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 02:42:02.285914 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-3483cdc0-5c2c-4a4b-8dea-d2f6441374b1 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:02.289315 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-6e74b85d-a48f-4f0e-af20-5475c658ca02 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.085938 Aug 09 02:42:02.289982 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 107/199] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Aug 9 02:42:02 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:42:02.304405 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-3483cdc0-5c2c-4a4b-8dea-d2f6441374b1 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507" status: 200 len: 1521 microversion: 2.1 time: 0.278626 Aug 09 02:42:02.306006 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 93/200] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:02 2022] GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507 => generated 1521 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:02.523780 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-e513e9ca-6396-45ce-9832-d48f73c5d6e2 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1888324192", "imageRef": "9a0b7d5f-e7c7-4bdd-a05f-89b820ee8521", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-523919105", "networks": [{"uuid": "fe941757-a8c5-41ae-b46b-5e1da78209e3"}]}} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:42:02.611464 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.network.neutron [None req-e513e9ca-6396-45ce-9832-d48f73c5d6e2 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] validate_networks() for [('fe941757-a8c5-41ae-b46b-5e1da78209e3', None, None, None, None, None)] {{(pid=124427) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 02:42:03.161870 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.virt.hardware [None req-e513e9ca-6396-45ce-9832-d48f73c5d6e2 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Flavor limits 0:0:0 {{(pid=124427) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 02:42:03.162450 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.virt.hardware [None req-e513e9ca-6396-45ce-9832-d48f73c5d6e2 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Image limits 0:0:0 {{(pid=124427) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 02:42:03.163015 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.virt.hardware [None req-e513e9ca-6396-45ce-9832-d48f73c5d6e2 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Flavor pref 0:0:0 {{(pid=124427) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 02:42:03.163749 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.virt.hardware [None req-e513e9ca-6396-45ce-9832-d48f73c5d6e2 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Image pref 0:0:0 {{(pid=124427) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 02:42:03.164493 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.virt.hardware [None req-e513e9ca-6396-45ce-9832-d48f73c5d6e2 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124427) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 02:42:03.176215 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e513e9ca-6396-45ce-9832-d48f73c5d6e2 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:03.176973 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e513e9ca-6396-45ce-9832-d48f73c5d6e2 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:03.177660 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e513e9ca-6396-45ce-9832-d48f73c5d6e2 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:03.178616 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e513e9ca-6396-45ce-9832-d48f73c5d6e2 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:03.180026 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e513e9ca-6396-45ce-9832-d48f73c5d6e2 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:03.180761 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e513e9ca-6396-45ce-9832-d48f73c5d6e2 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:03.218034 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.quota [None req-e513e9ca-6396-45ce-9832-d48f73c5d6e2 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Getting quotas for project f0a5508bdf5e4577b49783c3e424f1ee. Resources: {'cores', 'ram', 'instances'} {{(pid=124427) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 02:42:03.223961 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.quota [None req-e513e9ca-6396-45ce-9832-d48f73c5d6e2 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Getting quotas for user f6d6b64eb434414ab61f19b170385c3d and project f0a5508bdf5e4577b49783c3e424f1ee. Resources: {'cores', 'ram', 'instances'} {{(pid=124427) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 02:42:03.238467 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-e513e9ca-6396-45ce-9832-d48f73c5d6e2 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Going to run 1 instances... {{(pid=124427) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 02:42:03.240735 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-e513e9ca-6396-45ce-9832-d48f73c5d6e2 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] [instance: 7cfae5d5-8846-4c6d-8e56-5a52f817b48e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9a0b7d5f-e7c7-4bdd-a05f-89b820ee8521',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124427) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 02:42:03.322209 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-e513e9ca-6396-45ce-9832-d48f73c5d6e2 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.802663 Aug 09 02:42:03.328348 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 108/201] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Aug 9 02:42:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 810 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 02:42:03.332418 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-9ad35277-0504-4960-827d-ca3c6422e4bf tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:03.333269 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-9ad35277-0504-4960-827d-ca3c6422e4bf tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:03.334190 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-32d4267f-18b1-4c9a-9ab5-67a4e0879730 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:03.334971 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-32d4267f-18b1-4c9a-9ab5-67a4e0879730 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] [instance: 7cfae5d5-8846-4c6d-8e56-5a52f817b48e] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:03.342192 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9ad35277-0504-4960-827d-ca3c6422e4bf tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:03.347137 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9ad35277-0504-4960-827d-ca3c6422e4bf tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:03.348132 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9ad35277-0504-4960-827d-ca3c6422e4bf tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:03.352723 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9ad35277-0504-4960-827d-ca3c6422e4bf tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:03.359287 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9ad35277-0504-4960-827d-ca3c6422e4bf tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:03.359745 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9ad35277-0504-4960-827d-ca3c6422e4bf tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:03.435096 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-32d4267f-18b1-4c9a-9ab5-67a4e0879730 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6b64eb434414ab61f19b170385c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5508bdf5e4577b49783c3e424f1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:03.442938 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-32d4267f-18b1-4c9a-9ab5-67a4e0879730 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] 10.222.0.20 "GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e" status: 200 len: 1258 microversion: 2.1 time: 0.113243 Aug 09 02:42:03.443542 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 109/202] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:03 2022] GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e => generated 1258 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:03.767173 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-9ad35277-0504-4960-827d-ca3c6422e4bf tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:03.779437 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-9ad35277-0504-4960-827d-ca3c6422e4bf tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507" status: 200 len: 1521 microversion: 2.1 time: 0.456894 Aug 09 02:42:03.780032 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 94/203] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:03 2022] GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507 => generated 1521 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:03.981976 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-7b3b849d-798e-47f3-928c-49a8aaf3d574 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Action: 'create', calling method: .version_select at 0x7fb0a0613af0>, body: {"keypair": {"name": "tempest-keypair-1330101049", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOfanLfbskWzx2oAsNk1THn5bq0wsBx+bs6oQa3uI2NhsmVKULW0mB9Oi85gJvApAAR/5GeHbx2Uyi0abepkYRSUk9Lc0DfXjsb4EDicA0z/hw6v4ZEnztXfKIyayf4oTw=="}} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:42:04.001924 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.quota [None req-7b3b849d-798e-47f3-928c-49a8aaf3d574 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Getting quotas for project ca6695b7eb3b40ecb4d46292a95e6122. Resources: {'key_pairs'} {{(pid=124427) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 02:42:04.006561 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.quota [None req-7b3b849d-798e-47f3-928c-49a8aaf3d574 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Getting quotas for user 81447e83a97b4519ac6d0eac9a06bdef and project ca6695b7eb3b40ecb4d46292a95e6122. Resources: {'key_pairs'} {{(pid=124427) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 02:42:04.041973 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-7b3b849d-798e-47f3-928c-49a8aaf3d574 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.266060 Aug 09 02:42:04.047590 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 110/204] 10.222.0.20 () {62 vars in 1200 bytes} [Tue Aug 9 02:42:03 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 272 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 09 02:42:04.470530 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-191e2f27-73e5-48b8-a362-28efb4c274a9 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:04.476567 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-191e2f27-73e5-48b8-a362-28efb4c274a9 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] [instance: 7cfae5d5-8846-4c6d-8e56-5a52f817b48e] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:04.494540 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-191e2f27-73e5-48b8-a362-28efb4c274a9 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:04.495469 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-191e2f27-73e5-48b8-a362-28efb4c274a9 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:04.496075 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-191e2f27-73e5-48b8-a362-28efb4c274a9 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:04.496950 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-191e2f27-73e5-48b8-a362-28efb4c274a9 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:04.497466 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-191e2f27-73e5-48b8-a362-28efb4c274a9 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:04.498050 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-191e2f27-73e5-48b8-a362-28efb4c274a9 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:04.686136 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-191e2f27-73e5-48b8-a362-28efb4c274a9 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6b64eb434414ab61f19b170385c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5508bdf5e4577b49783c3e424f1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:04.709330 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-191e2f27-73e5-48b8-a362-28efb4c274a9 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] 10.222.0.20 "GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e" status: 200 len: 1254 microversion: 2.1 time: 0.247365 Aug 09 02:42:04.711282 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 95/205] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:04 2022] GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e => generated 1254 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:04.805478 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-466ce335-64a3-429b-9eb2-40bf5e1973ff tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:04.806603 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-466ce335-64a3-429b-9eb2-40bf5e1973ff tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:04.818508 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-466ce335-64a3-429b-9eb2-40bf5e1973ff tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:04.819849 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-466ce335-64a3-429b-9eb2-40bf5e1973ff tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:04.820577 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-466ce335-64a3-429b-9eb2-40bf5e1973ff tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:04.822287 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-466ce335-64a3-429b-9eb2-40bf5e1973ff tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:04.822957 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-466ce335-64a3-429b-9eb2-40bf5e1973ff tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:04.823556 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-466ce335-64a3-429b-9eb2-40bf5e1973ff tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:05.072395 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-466ce335-64a3-429b-9eb2-40bf5e1973ff tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:05.082080 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-466ce335-64a3-429b-9eb2-40bf5e1973ff tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507" status: 200 len: 1521 microversion: 2.1 time: 0.283880 Aug 09 02:42:05.083081 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 111/206] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:04 2022] GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507 => generated 1521 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:05.734256 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-1dd6e8e9-2dfb-45eb-91d4-16b578cf267a tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:05.735058 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-1dd6e8e9-2dfb-45eb-91d4-16b578cf267a tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] [instance: 7cfae5d5-8846-4c6d-8e56-5a52f817b48e] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:05.747928 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1dd6e8e9-2dfb-45eb-91d4-16b578cf267a tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:05.748695 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1dd6e8e9-2dfb-45eb-91d4-16b578cf267a tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:05.749358 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1dd6e8e9-2dfb-45eb-91d4-16b578cf267a tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:05.750488 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1dd6e8e9-2dfb-45eb-91d4-16b578cf267a tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:05.751215 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1dd6e8e9-2dfb-45eb-91d4-16b578cf267a tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:05.751781 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1dd6e8e9-2dfb-45eb-91d4-16b578cf267a tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:05.924977 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-1dd6e8e9-2dfb-45eb-91d4-16b578cf267a tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6b64eb434414ab61f19b170385c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5508bdf5e4577b49783c3e424f1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:05.940184 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-1dd6e8e9-2dfb-45eb-91d4-16b578cf267a tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] 10.222.0.20 "GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e" status: 200 len: 1316 microversion: 2.1 time: 0.211284 Aug 09 02:42:05.941276 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 96/207] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:05 2022] GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e => generated 1316 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:06.105143 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-5defbf5e-d05a-4309-bb0d-dc47b74958cc tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:06.106368 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-5defbf5e-d05a-4309-bb0d-dc47b74958cc tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:06.127110 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5defbf5e-d05a-4309-bb0d-dc47b74958cc tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:06.127935 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5defbf5e-d05a-4309-bb0d-dc47b74958cc tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:06.130807 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5defbf5e-d05a-4309-bb0d-dc47b74958cc tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:06.132183 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5defbf5e-d05a-4309-bb0d-dc47b74958cc tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:06.135452 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5defbf5e-d05a-4309-bb0d-dc47b74958cc tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:06.142861 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5defbf5e-d05a-4309-bb0d-dc47b74958cc tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:06.549795 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-5defbf5e-d05a-4309-bb0d-dc47b74958cc tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:06.564035 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-5defbf5e-d05a-4309-bb0d-dc47b74958cc tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507" status: 200 len: 1521 microversion: 2.1 time: 0.463240 Aug 09 02:42:06.564800 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 112/208] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:06 2022] GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507 => generated 1521 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:06.966515 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-42375b39-4ecd-4a16-86fd-416e003c69b0 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:06.967104 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-42375b39-4ecd-4a16-86fd-416e003c69b0 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] [instance: 7cfae5d5-8846-4c6d-8e56-5a52f817b48e] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:06.978638 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-42375b39-4ecd-4a16-86fd-416e003c69b0 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:06.979131 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-42375b39-4ecd-4a16-86fd-416e003c69b0 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:06.979570 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-42375b39-4ecd-4a16-86fd-416e003c69b0 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:06.980639 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-42375b39-4ecd-4a16-86fd-416e003c69b0 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:06.981092 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-42375b39-4ecd-4a16-86fd-416e003c69b0 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:06.981509 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-42375b39-4ecd-4a16-86fd-416e003c69b0 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:07.585792 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-3c6e077a-0841-4881-9d33-cfcd84cf9c2e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:07.587471 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-3c6e077a-0841-4881-9d33-cfcd84cf9c2e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:07.601563 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3c6e077a-0841-4881-9d33-cfcd84cf9c2e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:07.602064 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3c6e077a-0841-4881-9d33-cfcd84cf9c2e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:07.602568 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3c6e077a-0841-4881-9d33-cfcd84cf9c2e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:07.603287 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3c6e077a-0841-4881-9d33-cfcd84cf9c2e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:07.609842 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3c6e077a-0841-4881-9d33-cfcd84cf9c2e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:07.613669 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3c6e077a-0841-4881-9d33-cfcd84cf9c2e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:07.627954 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-42375b39-4ecd-4a16-86fd-416e003c69b0 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6b64eb434414ab61f19b170385c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5508bdf5e4577b49783c3e424f1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:07.647040 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-42375b39-4ecd-4a16-86fd-416e003c69b0 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] 10.222.0.20 "GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e" status: 200 len: 1358 microversion: 2.1 time: 0.684052 Aug 09 02:42:07.666199 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 97/209] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:06 2022] GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e => generated 1358 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:08.066925 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-750127fd-7db2-427e-a0f6-589b17e4c464 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1019090991", "imageRef": "04a06944-b2a8-4a65-b2a6-7ed3ff18a627", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0f4ed732-540e-4797-ab30-71de6f473add"}], "security_groups": [{"name": "tempest-securitygroup--1170495673"}], "key_name": "tempest-keypair-1330101049", "user_data": "}} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:42:08.675995 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-3c6e077a-0841-4881-9d33-cfcd84cf9c2e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:08.689490 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-3c6e077a-0841-4881-9d33-cfcd84cf9c2e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507" status: 200 len: 1521 microversion: 2.1 time: 1.108237 Aug 09 02:42:08.690081 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 113/210] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:07 2022] GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507 => generated 1521 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:08.695273 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.network.neutron [None req-750127fd-7db2-427e-a0f6-589b17e4c464 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] validate_networks() for [('0f4ed732-540e-4797-ab30-71de6f473add', None, None, None, None, None)] {{(pid=124425) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 02:42:08.719101 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-bf56117c-8d32-43bb-b746-80fd807bbd68 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:08.721282 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-bf56117c-8d32-43bb-b746-80fd807bbd68 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] [instance: 7cfae5d5-8846-4c6d-8e56-5a52f817b48e] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:08.734650 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-bf56117c-8d32-43bb-b746-80fd807bbd68 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:08.735141 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-bf56117c-8d32-43bb-b746-80fd807bbd68 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:08.735749 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-bf56117c-8d32-43bb-b746-80fd807bbd68 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:08.736647 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-bf56117c-8d32-43bb-b746-80fd807bbd68 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:08.738649 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-bf56117c-8d32-43bb-b746-80fd807bbd68 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:08.739246 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-bf56117c-8d32-43bb-b746-80fd807bbd68 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:08.786953 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:42:09.429767 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-bf56117c-8d32-43bb-b746-80fd807bbd68 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6b64eb434414ab61f19b170385c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5508bdf5e4577b49783c3e424f1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:09.440600 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-bf56117c-8d32-43bb-b746-80fd807bbd68 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] 10.222.0.20 "GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e" status: 200 len: 1358 microversion: 2.1 time: 0.730211 Aug 09 02:42:09.443600 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 114/211] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:08 2022] GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e => generated 1358 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:09.715907 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-64bb4e0e-c4a0-4092-84d6-bcc150d0d53f tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:09.719627 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-64bb4e0e-c4a0-4092-84d6-bcc150d0d53f tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:09.734124 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-64bb4e0e-c4a0-4092-84d6-bcc150d0d53f tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:09.735028 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-64bb4e0e-c4a0-4092-84d6-bcc150d0d53f tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:09.735552 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-64bb4e0e-c4a0-4092-84d6-bcc150d0d53f tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:09.736563 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-64bb4e0e-c4a0-4092-84d6-bcc150d0d53f tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:09.737406 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-64bb4e0e-c4a0-4092-84d6-bcc150d0d53f tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:09.737873 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-64bb4e0e-c4a0-4092-84d6-bcc150d0d53f tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:10.544493 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-64bb4e0e-c4a0-4092-84d6-bcc150d0d53f tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:10.570900 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-64bb4e0e-c4a0-4092-84d6-bcc150d0d53f tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507" status: 200 len: 1521 microversion: 2.1 time: 0.859327 Aug 09 02:42:10.575249 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 115/212] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:09 2022] GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507 => generated 1521 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:10.590398 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-4a5aa846-b6cd-4149-bb01-b1bb659d7860 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:10.592728 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-4a5aa846-b6cd-4149-bb01-b1bb659d7860 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] [instance: 7cfae5d5-8846-4c6d-8e56-5a52f817b48e] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:10.620401 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4a5aa846-b6cd-4149-bb01-b1bb659d7860 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:10.623554 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4a5aa846-b6cd-4149-bb01-b1bb659d7860 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:10.624310 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4a5aa846-b6cd-4149-bb01-b1bb659d7860 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:10.625695 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4a5aa846-b6cd-4149-bb01-b1bb659d7860 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:10.638535 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4a5aa846-b6cd-4149-bb01-b1bb659d7860 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:10.638961 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4a5aa846-b6cd-4149-bb01-b1bb659d7860 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:10.719388 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.virt.hardware [None req-750127fd-7db2-427e-a0f6-589b17e4c464 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Flavor limits 0:0:0 {{(pid=124425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 02:42:10.720077 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.virt.hardware [None req-750127fd-7db2-427e-a0f6-589b17e4c464 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Image limits 0:0:0 {{(pid=124425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 02:42:10.720734 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.virt.hardware [None req-750127fd-7db2-427e-a0f6-589b17e4c464 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Flavor pref 0:0:0 {{(pid=124425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 02:42:10.721292 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.virt.hardware [None req-750127fd-7db2-427e-a0f6-589b17e4c464 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Image pref 0:0:0 {{(pid=124425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 02:42:10.721872 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.virt.hardware [None req-750127fd-7db2-427e-a0f6-589b17e4c464 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 02:42:10.740935 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-750127fd-7db2-427e-a0f6-589b17e4c464 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:10.742362 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-750127fd-7db2-427e-a0f6-589b17e4c464 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:10.743373 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-750127fd-7db2-427e-a0f6-589b17e4c464 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:10.745078 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-750127fd-7db2-427e-a0f6-589b17e4c464 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:10.745805 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-750127fd-7db2-427e-a0f6-589b17e4c464 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:10.746988 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-750127fd-7db2-427e-a0f6-589b17e4c464 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:10.803270 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.quota [None req-750127fd-7db2-427e-a0f6-589b17e4c464 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Getting quotas for project ca6695b7eb3b40ecb4d46292a95e6122. Resources: {'cores', 'ram', 'instances'} {{(pid=124425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 02:42:10.826966 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.quota [None req-750127fd-7db2-427e-a0f6-589b17e4c464 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Getting quotas for user 81447e83a97b4519ac6d0eac9a06bdef and project ca6695b7eb3b40ecb4d46292a95e6122. Resources: {'cores', 'ram', 'instances'} {{(pid=124425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 02:42:10.863596 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-750127fd-7db2-427e-a0f6-589b17e4c464 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Going to run 1 instances... {{(pid=124425) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 02:42:10.866193 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-750127fd-7db2-427e-a0f6-589b17e4c464 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='04a06944-b2a8-4a65-b2a6-7ed3ff18a627',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 02:42:10.983609 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-750127fd-7db2-427e-a0f6-589b17e4c464 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.920945 Aug 09 02:42:10.985204 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 98/213] 10.222.0.20 () {62 vars in 1188 bytes} [Tue Aug 9 02:42:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 2924 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 09 02:42:11.009789 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-665caeb6-3b3c-45e2-b1f0-3a02c62d3ca1 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:11.011146 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-665caeb6-3b3c-45e2-b1f0-3a02c62d3ca1 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:11.352980 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-4a5aa846-b6cd-4149-bb01-b1bb659d7860 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6b64eb434414ab61f19b170385c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5508bdf5e4577b49783c3e424f1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:11.357974 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-665caeb6-3b3c-45e2-b1f0-3a02c62d3ca1 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:11.363277 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-4a5aa846-b6cd-4149-bb01-b1bb659d7860 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] 10.222.0.20 "GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e" status: 200 len: 1358 microversion: 2.1 time: 0.785768 Aug 09 02:42:11.363891 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 116/214] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:10 2022] GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e => generated 1358 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:11.383722 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-665caeb6-3b3c-45e2-b1f0-3a02c62d3ca1 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:11.388100 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-665caeb6-3b3c-45e2-b1f0-3a02c62d3ca1 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:11.394975 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-665caeb6-3b3c-45e2-b1f0-3a02c62d3ca1 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1282 microversion: 2.20 time: 0.394608 Aug 09 02:42:11.395861 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 99/215] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:42:10 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1282 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:42:11.426734 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [req-71d702f4-d7f5-4737-b691-d0a40003ea56 req-fd75d225-23d6-4468-a556-02dbd11d3941 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cfae5d5-8846-4c6d-8e56-5a52f817b48e", "tag": "e3bd4b2e-303f-4020-9be9-d72af9307f8a"}]} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:42:11.468269 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-71d702f4-d7f5-4737-b691-d0a40003ea56 req-fd75d225-23d6-4468-a556-02dbd11d3941 service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:11.470871 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-71d702f4-d7f5-4737-b691-d0a40003ea56 req-fd75d225-23d6-4468-a556-02dbd11d3941 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:11.470871 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-71d702f4-d7f5-4737-b691-d0a40003ea56 req-fd75d225-23d6-4468-a556-02dbd11d3941 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:11.527541 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.compute.server_external_events [req-71d702f4-d7f5-4737-b691-d0a40003ea56 req-fd75d225-23d6-4468-a556-02dbd11d3941 service nova] Creating event network-changed:e3bd4b2e-303f-4020-9be9-d72af9307f8a for instance 7cfae5d5-8846-4c6d-8e56-5a52f817b48e on hv-cinder-85246 Aug 09 02:42:11.546376 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [req-71d702f4-d7f5-4737-b691-d0a40003ea56 req-fd75d225-23d6-4468-a556-02dbd11d3941 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122941 Aug 09 02:42:11.554757 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 117/216] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:42:11.616472 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-973c82d8-288a-4cc6-a827-56eb5011405b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:11.617842 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-973c82d8-288a-4cc6-a827-56eb5011405b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:11.631694 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-973c82d8-288a-4cc6-a827-56eb5011405b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:11.632970 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-973c82d8-288a-4cc6-a827-56eb5011405b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:11.633777 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-973c82d8-288a-4cc6-a827-56eb5011405b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:11.634880 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-973c82d8-288a-4cc6-a827-56eb5011405b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:11.635605 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-973c82d8-288a-4cc6-a827-56eb5011405b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:11.636539 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-973c82d8-288a-4cc6-a827-56eb5011405b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:11.954994 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-973c82d8-288a-4cc6-a827-56eb5011405b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:11.979305 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-973c82d8-288a-4cc6-a827-56eb5011405b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507" status: 200 len: 1521 microversion: 2.1 time: 0.368231 Aug 09 02:42:11.982947 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 100/217] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:11 2022] GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507 => generated 1521 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:12.385890 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-6a7794f4-2e67-4f99-baeb-d6b5f34f5f01 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:12.386647 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-6a7794f4-2e67-4f99-baeb-d6b5f34f5f01 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] [instance: 7cfae5d5-8846-4c6d-8e56-5a52f817b48e] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:12.397800 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6a7794f4-2e67-4f99-baeb-d6b5f34f5f01 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:12.398404 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6a7794f4-2e67-4f99-baeb-d6b5f34f5f01 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:12.399145 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6a7794f4-2e67-4f99-baeb-d6b5f34f5f01 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:12.400264 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6a7794f4-2e67-4f99-baeb-d6b5f34f5f01 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:12.401075 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6a7794f4-2e67-4f99-baeb-d6b5f34f5f01 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:12.401666 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6a7794f4-2e67-4f99-baeb-d6b5f34f5f01 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:12.419562 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-ad0af849-bcd6-48d1-bb35-09bb4598c123 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:12.420172 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-ad0af849-bcd6-48d1-bb35-09bb4598c123 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:12.429429 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ad0af849-bcd6-48d1-bb35-09bb4598c123 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:12.429906 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ad0af849-bcd6-48d1-bb35-09bb4598c123 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:12.430332 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ad0af849-bcd6-48d1-bb35-09bb4598c123 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:12.431055 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ad0af849-bcd6-48d1-bb35-09bb4598c123 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:12.431493 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ad0af849-bcd6-48d1-bb35-09bb4598c123 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:12.446950 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ad0af849-bcd6-48d1-bb35-09bb4598c123 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:12.550788 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-ad0af849-bcd6-48d1-bb35-09bb4598c123 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:12.559165 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-ad0af849-bcd6-48d1-bb35-09bb4598c123 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:12.571661 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-ad0af849-bcd6-48d1-bb35-09bb4598c123 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:12.572846 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-ad0af849-bcd6-48d1-bb35-09bb4598c123 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1286 microversion: 2.20 time: 0.158551 Aug 09 02:42:12.573703 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 101/218] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:42:12 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1286 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:42:12.668177 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-6a7794f4-2e67-4f99-baeb-d6b5f34f5f01 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6b64eb434414ab61f19b170385c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5508bdf5e4577b49783c3e424f1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:12.677098 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-6a7794f4-2e67-4f99-baeb-d6b5f34f5f01 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] 10.222.0.20 "GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e" status: 200 len: 1358 microversion: 2.1 time: 0.295730 Aug 09 02:42:12.677679 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 118/219] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:12 2022] GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e => generated 1358 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:13.005540 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-a3db6bdf-d47a-4652-a4fe-89252706cf13 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:13.006281 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-a3db6bdf-d47a-4652-a4fe-89252706cf13 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:13.019669 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a3db6bdf-d47a-4652-a4fe-89252706cf13 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:13.020358 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a3db6bdf-d47a-4652-a4fe-89252706cf13 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:13.020898 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a3db6bdf-d47a-4652-a4fe-89252706cf13 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:13.021716 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a3db6bdf-d47a-4652-a4fe-89252706cf13 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:13.022335 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a3db6bdf-d47a-4652-a4fe-89252706cf13 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:13.023078 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a3db6bdf-d47a-4652-a4fe-89252706cf13 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:13.183437 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-a3db6bdf-d47a-4652-a4fe-89252706cf13 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:13.192602 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-a3db6bdf-d47a-4652-a4fe-89252706cf13 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507" status: 200 len: 1521 microversion: 2.1 time: 0.191147 Aug 09 02:42:13.194373 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 102/220] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:13 2022] GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:13.599047 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-ea8e84e5-3514-47eb-98a7-18528acd7ad1 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:13.599770 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-ea8e84e5-3514-47eb-98a7-18528acd7ad1 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:13.602072 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_cell0:SELECT=2 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:42:13.608279 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ea8e84e5-3514-47eb-98a7-18528acd7ad1 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:13.609002 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ea8e84e5-3514-47eb-98a7-18528acd7ad1 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:13.609426 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ea8e84e5-3514-47eb-98a7-18528acd7ad1 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:13.610146 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ea8e84e5-3514-47eb-98a7-18528acd7ad1 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:13.610616 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ea8e84e5-3514-47eb-98a7-18528acd7ad1 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:13.611104 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ea8e84e5-3514-47eb-98a7-18528acd7ad1 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:13.701914 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-d04dcb2a-9f90-48c2-afd3-1bfa0cd32bfa tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:13.702750 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-d04dcb2a-9f90-48c2-afd3-1bfa0cd32bfa tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] [instance: 7cfae5d5-8846-4c6d-8e56-5a52f817b48e] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:13.709508 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d04dcb2a-9f90-48c2-afd3-1bfa0cd32bfa tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:13.710055 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d04dcb2a-9f90-48c2-afd3-1bfa0cd32bfa tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:13.710583 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d04dcb2a-9f90-48c2-afd3-1bfa0cd32bfa tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:13.711321 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d04dcb2a-9f90-48c2-afd3-1bfa0cd32bfa tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:13.711761 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d04dcb2a-9f90-48c2-afd3-1bfa0cd32bfa tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:13.712266 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d04dcb2a-9f90-48c2-afd3-1bfa0cd32bfa tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:13.765781 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-ea8e84e5-3514-47eb-98a7-18528acd7ad1 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:13.778928 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-ea8e84e5-3514-47eb-98a7-18528acd7ad1 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:13.780721 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-ea8e84e5-3514-47eb-98a7-18528acd7ad1 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:13.782908 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-ea8e84e5-3514-47eb-98a7-18528acd7ad1 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1286 microversion: 2.20 time: 0.187658 Aug 09 02:42:13.784322 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 119/221] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:42:13 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1286 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:42:14.200082 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-d04dcb2a-9f90-48c2-afd3-1bfa0cd32bfa tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6b64eb434414ab61f19b170385c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5508bdf5e4577b49783c3e424f1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:14.207544 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-d04dcb2a-9f90-48c2-afd3-1bfa0cd32bfa tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] 10.222.0.20 "GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e" status: 200 len: 1358 microversion: 2.1 time: 0.510605 Aug 09 02:42:14.218189 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 103/222] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:13 2022] GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e => generated 1358 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:14.218418 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-461c13d5-9de6-45a8-908a-db3aa1b59d2b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:14.218418 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-461c13d5-9de6-45a8-908a-db3aa1b59d2b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:14.219137 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_cell0:SELECT=16 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:42:14.224773 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-461c13d5-9de6-45a8-908a-db3aa1b59d2b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:14.225262 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-461c13d5-9de6-45a8-908a-db3aa1b59d2b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:14.225695 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-461c13d5-9de6-45a8-908a-db3aa1b59d2b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:14.226447 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-461c13d5-9de6-45a8-908a-db3aa1b59d2b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:14.226914 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-461c13d5-9de6-45a8-908a-db3aa1b59d2b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:14.227281 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-461c13d5-9de6-45a8-908a-db3aa1b59d2b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:14.473813 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-461c13d5-9de6-45a8-908a-db3aa1b59d2b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:14.485279 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-461c13d5-9de6-45a8-908a-db3aa1b59d2b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507" status: 200 len: 1521 microversion: 2.1 time: 0.272160 Aug 09 02:42:14.487029 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 120/223] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:14 2022] GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507 => generated 1521 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:14.806345 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-c158347c-5269-4e89-8624-a3a6fc1e9f3a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:14.806958 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-c158347c-5269-4e89-8624-a3a6fc1e9f3a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:14.813335 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c158347c-5269-4e89-8624-a3a6fc1e9f3a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:14.813806 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c158347c-5269-4e89-8624-a3a6fc1e9f3a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:14.814283 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c158347c-5269-4e89-8624-a3a6fc1e9f3a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:14.814962 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c158347c-5269-4e89-8624-a3a6fc1e9f3a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:14.815402 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c158347c-5269-4e89-8624-a3a6fc1e9f3a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:14.815815 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c158347c-5269-4e89-8624-a3a6fc1e9f3a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:14.925618 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-c158347c-5269-4e89-8624-a3a6fc1e9f3a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:14.948437 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-c158347c-5269-4e89-8624-a3a6fc1e9f3a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:14.951061 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-c158347c-5269-4e89-8624-a3a6fc1e9f3a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:14.952873 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-c158347c-5269-4e89-8624-a3a6fc1e9f3a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1286 microversion: 2.20 time: 0.150570 Aug 09 02:42:14.954614 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 104/224] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:42:14 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1286 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:42:15.233214 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-fb6b33a0-4e7b-44f7-bc63-1c52b77ee81f tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:15.235775 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-fb6b33a0-4e7b-44f7-bc63-1c52b77ee81f tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] [instance: 7cfae5d5-8846-4c6d-8e56-5a52f817b48e] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:15.245437 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-fb6b33a0-4e7b-44f7-bc63-1c52b77ee81f tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:15.246092 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-fb6b33a0-4e7b-44f7-bc63-1c52b77ee81f tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:15.246569 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-fb6b33a0-4e7b-44f7-bc63-1c52b77ee81f tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:15.247278 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-fb6b33a0-4e7b-44f7-bc63-1c52b77ee81f tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:15.248917 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-fb6b33a0-4e7b-44f7-bc63-1c52b77ee81f tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:15.249824 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-fb6b33a0-4e7b-44f7-bc63-1c52b77ee81f tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:15.425100 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-fb6b33a0-4e7b-44f7-bc63-1c52b77ee81f tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6b64eb434414ab61f19b170385c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5508bdf5e4577b49783c3e424f1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:15.433582 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-fb6b33a0-4e7b-44f7-bc63-1c52b77ee81f tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] 10.222.0.20 "GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e" status: 200 len: 1358 microversion: 2.1 time: 0.206373 Aug 09 02:42:15.434447 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 121/225] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:15 2022] GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e => generated 1358 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:42:15.507135 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-11725f8a-19ab-4c3a-b7d1-2db4b0ea0c5e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:15.507814 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-11725f8a-19ab-4c3a-b7d1-2db4b0ea0c5e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:15.514247 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-11725f8a-19ab-4c3a-b7d1-2db4b0ea0c5e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:15.514968 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-11725f8a-19ab-4c3a-b7d1-2db4b0ea0c5e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:15.515577 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-11725f8a-19ab-4c3a-b7d1-2db4b0ea0c5e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:15.516434 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-11725f8a-19ab-4c3a-b7d1-2db4b0ea0c5e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:15.517029 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-11725f8a-19ab-4c3a-b7d1-2db4b0ea0c5e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:15.517670 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-11725f8a-19ab-4c3a-b7d1-2db4b0ea0c5e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:15.538791 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-7dec1fbe-c1da-4e87-9b05-48b989e9edcb tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:15.539281 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-7dec1fbe-c1da-4e87-9b05-48b989e9edcb tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:15.545282 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7dec1fbe-c1da-4e87-9b05-48b989e9edcb tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:15.545766 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7dec1fbe-c1da-4e87-9b05-48b989e9edcb tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:15.546222 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7dec1fbe-c1da-4e87-9b05-48b989e9edcb tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:15.547121 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7dec1fbe-c1da-4e87-9b05-48b989e9edcb tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:15.547842 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7dec1fbe-c1da-4e87-9b05-48b989e9edcb tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:15.548289 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7dec1fbe-c1da-4e87-9b05-48b989e9edcb tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:15.590204 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-7dec1fbe-c1da-4e87-9b05-48b989e9edcb tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a/ips" status: 200 len: 150 microversion: 2.1 time: 0.055442 Aug 09 02:42:15.596021 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 122/226] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Aug 9 02:42:15 2022] GET /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a/ips => generated 150 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:42:15.693477 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-11725f8a-19ab-4c3a-b7d1-2db4b0ea0c5e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:15.709132 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-11725f8a-19ab-4c3a-b7d1-2db4b0ea0c5e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507" status: 200 len: 1521 microversion: 2.1 time: 0.205472 Aug 09 02:42:15.710583 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 105/227] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:15 2022] GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507 => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:15.978396 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-db32425f-4493-4c7a-acf5-ab835fd2b2e5 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:15.978396 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-db32425f-4493-4c7a-acf5-ab835fd2b2e5 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:16.009916 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-db32425f-4493-4c7a-acf5-ab835fd2b2e5 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:16.009916 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-db32425f-4493-4c7a-acf5-ab835fd2b2e5 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:16.013227 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-db32425f-4493-4c7a-acf5-ab835fd2b2e5 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:16.014341 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-db32425f-4493-4c7a-acf5-ab835fd2b2e5 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:16.018249 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-db32425f-4493-4c7a-acf5-ab835fd2b2e5 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:16.019226 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-db32425f-4493-4c7a-acf5-ab835fd2b2e5 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:16.172621 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-db32425f-4493-4c7a-acf5-ab835fd2b2e5 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:16.188668 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-db32425f-4493-4c7a-acf5-ab835fd2b2e5 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:16.195952 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-db32425f-4493-4c7a-acf5-ab835fd2b2e5 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:16.200012 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-db32425f-4493-4c7a-acf5-ab835fd2b2e5 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1286 microversion: 2.20 time: 0.225351 Aug 09 02:42:16.200783 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 123/228] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:42:15 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1286 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:42:16.455896 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-4c6c8af4-2833-48ef-b4ee-4328846fed35 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:16.456785 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-4c6c8af4-2833-48ef-b4ee-4328846fed35 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] [instance: 7cfae5d5-8846-4c6d-8e56-5a52f817b48e] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:16.492601 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4c6c8af4-2833-48ef-b4ee-4328846fed35 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:16.493135 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4c6c8af4-2833-48ef-b4ee-4328846fed35 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:16.494738 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4c6c8af4-2833-48ef-b4ee-4328846fed35 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:16.497740 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4c6c8af4-2833-48ef-b4ee-4328846fed35 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:16.498573 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4c6c8af4-2833-48ef-b4ee-4328846fed35 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:16.499222 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4c6c8af4-2833-48ef-b4ee-4328846fed35 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:16.664662 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-4c6c8af4-2833-48ef-b4ee-4328846fed35 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6b64eb434414ab61f19b170385c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5508bdf5e4577b49783c3e424f1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:16.672970 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-4c6c8af4-2833-48ef-b4ee-4328846fed35 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] 10.222.0.20 "GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e" status: 200 len: 1358 microversion: 2.1 time: 0.221372 Aug 09 02:42:16.673634 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 106/229] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:16 2022] GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e => generated 1358 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:16.731591 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-22706d31-4326-4bde-9d1e-e764d5804495 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:16.733053 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-22706d31-4326-4bde-9d1e-e764d5804495 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:16.740214 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-22706d31-4326-4bde-9d1e-e764d5804495 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:16.741099 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-22706d31-4326-4bde-9d1e-e764d5804495 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:16.741973 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-22706d31-4326-4bde-9d1e-e764d5804495 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:16.743200 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-22706d31-4326-4bde-9d1e-e764d5804495 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:16.743960 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-22706d31-4326-4bde-9d1e-e764d5804495 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:16.744407 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-22706d31-4326-4bde-9d1e-e764d5804495 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:16.901095 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-22706d31-4326-4bde-9d1e-e764d5804495 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:16.909401 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-22706d31-4326-4bde-9d1e-e764d5804495 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507" status: 200 len: 1521 microversion: 2.1 time: 0.182739 Aug 09 02:42:16.910091 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 124/230] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:16 2022] GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:17.181938 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-d66687f4-debb-4ed9-89df-e7b6edbfa964 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b0e4e615-98a6-4e60-b4cb-b4a6ac5d9cfc"}} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:42:17.184642 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-d66687f4-debb-4ed9-89df-e7b6edbfa964 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:17.191104 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d66687f4-debb-4ed9-89df-e7b6edbfa964 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:17.191849 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d66687f4-debb-4ed9-89df-e7b6edbfa964 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:17.192316 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d66687f4-debb-4ed9-89df-e7b6edbfa964 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:17.194341 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d66687f4-debb-4ed9-89df-e7b6edbfa964 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:17.194341 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d66687f4-debb-4ed9-89df-e7b6edbfa964 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:17.194341 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d66687f4-debb-4ed9-89df-e7b6edbfa964 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:17.223412 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-6a52c43e-0517-444b-bfe8-2db915308862 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:17.224382 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-6a52c43e-0517-444b-bfe8-2db915308862 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:17.237248 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6a52c43e-0517-444b-bfe8-2db915308862 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:17.237974 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6a52c43e-0517-444b-bfe8-2db915308862 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:17.239004 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6a52c43e-0517-444b-bfe8-2db915308862 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:17.239875 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6a52c43e-0517-444b-bfe8-2db915308862 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:17.240468 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6a52c43e-0517-444b-bfe8-2db915308862 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:17.241313 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6a52c43e-0517-444b-bfe8-2db915308862 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:17.337878 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-6a52c43e-0517-444b-bfe8-2db915308862 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:17.346325 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-6a52c43e-0517-444b-bfe8-2db915308862 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:17.347845 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-6a52c43e-0517-444b-bfe8-2db915308862 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:17.348958 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-6a52c43e-0517-444b-bfe8-2db915308862 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1286 microversion: 2.20 time: 0.129917 Aug 09 02:42:17.349689 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 125/231] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:42:17 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1286 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 02:42:17.673507 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-d66687f4-debb-4ed9-89df-e7b6edbfa964 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "POST /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.496636 Aug 09 02:42:17.674287 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 107/232] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Aug 9 02:42:17 2022] POST /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a/os-volume_attachments => generated 194 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:42:17.694361 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-14c5c0b5-cef8-43b3-895c-5f30d512bab1 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:17.695120 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-14c5c0b5-cef8-43b3-895c-5f30d512bab1 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] [instance: 7cfae5d5-8846-4c6d-8e56-5a52f817b48e] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:17.701386 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-14c5c0b5-cef8-43b3-895c-5f30d512bab1 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:17.701995 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-14c5c0b5-cef8-43b3-895c-5f30d512bab1 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:17.702557 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-14c5c0b5-cef8-43b3-895c-5f30d512bab1 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:17.703384 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-14c5c0b5-cef8-43b3-895c-5f30d512bab1 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:17.703937 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-14c5c0b5-cef8-43b3-895c-5f30d512bab1 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:17.704430 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-14c5c0b5-cef8-43b3-895c-5f30d512bab1 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:17.871885 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-14c5c0b5-cef8-43b3-895c-5f30d512bab1 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6b64eb434414ab61f19b170385c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5508bdf5e4577b49783c3e424f1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:17.905821 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-14c5c0b5-cef8-43b3-895c-5f30d512bab1 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] 10.222.0.20 "GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e" status: 200 len: 1358 microversion: 2.1 time: 0.215463 Aug 09 02:42:17.909197 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 126/233] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:17 2022] GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e => generated 1358 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:17.932199 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-b4fc9b09-4399-40ec-a16d-995075319b0a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:17.933018 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-b4fc9b09-4399-40ec-a16d-995075319b0a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:17.941675 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b4fc9b09-4399-40ec-a16d-995075319b0a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:17.942642 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b4fc9b09-4399-40ec-a16d-995075319b0a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:17.943138 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b4fc9b09-4399-40ec-a16d-995075319b0a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:17.943856 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b4fc9b09-4399-40ec-a16d-995075319b0a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:17.944298 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b4fc9b09-4399-40ec-a16d-995075319b0a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:17.944711 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b4fc9b09-4399-40ec-a16d-995075319b0a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:17.961479 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:42:18.105443 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-b4fc9b09-4399-40ec-a16d-995075319b0a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:18.117228 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-b4fc9b09-4399-40ec-a16d-995075319b0a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507" status: 200 len: 1521 microversion: 2.1 time: 0.189741 Aug 09 02:42:18.118356 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 108/234] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:17 2022] GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:42:18.372127 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-6ae94e0e-14d3-4601-9541-93f3dc1a5d3f tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:18.372845 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-6ae94e0e-14d3-4601-9541-93f3dc1a5d3f tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:18.380095 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6ae94e0e-14d3-4601-9541-93f3dc1a5d3f tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:18.380584 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6ae94e0e-14d3-4601-9541-93f3dc1a5d3f tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:18.381016 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6ae94e0e-14d3-4601-9541-93f3dc1a5d3f tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:18.381707 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6ae94e0e-14d3-4601-9541-93f3dc1a5d3f tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:18.382178 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6ae94e0e-14d3-4601-9541-93f3dc1a5d3f tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:18.382603 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6ae94e0e-14d3-4601-9541-93f3dc1a5d3f tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:18.451631 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-6ae94e0e-14d3-4601-9541-93f3dc1a5d3f tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:18.459851 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-6ae94e0e-14d3-4601-9541-93f3dc1a5d3f tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:18.461361 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-6ae94e0e-14d3-4601-9541-93f3dc1a5d3f tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:18.462526 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-6ae94e0e-14d3-4601-9541-93f3dc1a5d3f tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1334 microversion: 2.20 time: 0.094701 Aug 09 02:42:18.463332 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 127/235] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:42:18 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1334 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:42:18.925944 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-9d9b9404-59c1-4527-97d0-42246ea5e5eb tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:18.926559 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-9d9b9404-59c1-4527-97d0-42246ea5e5eb tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] [instance: 7cfae5d5-8846-4c6d-8e56-5a52f817b48e] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:18.935478 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9d9b9404-59c1-4527-97d0-42246ea5e5eb tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:18.935947 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9d9b9404-59c1-4527-97d0-42246ea5e5eb tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:18.936342 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9d9b9404-59c1-4527-97d0-42246ea5e5eb tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:18.937027 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9d9b9404-59c1-4527-97d0-42246ea5e5eb tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:18.937540 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9d9b9404-59c1-4527-97d0-42246ea5e5eb tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:18.937939 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9d9b9404-59c1-4527-97d0-42246ea5e5eb tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:19.139747 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-dcfa7d7d-efef-44bb-b9b6-3b726313ae08 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:19.140956 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-dcfa7d7d-efef-44bb-b9b6-3b726313ae08 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:19.143970 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=5 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:42:19.152090 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-dcfa7d7d-efef-44bb-b9b6-3b726313ae08 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:19.152643 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-dcfa7d7d-efef-44bb-b9b6-3b726313ae08 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:19.152994 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-dcfa7d7d-efef-44bb-b9b6-3b726313ae08 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:19.154027 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-dcfa7d7d-efef-44bb-b9b6-3b726313ae08 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:19.154279 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-dcfa7d7d-efef-44bb-b9b6-3b726313ae08 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:19.154566 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-dcfa7d7d-efef-44bb-b9b6-3b726313ae08 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:19.273129 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-9d9b9404-59c1-4527-97d0-42246ea5e5eb tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6b64eb434414ab61f19b170385c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5508bdf5e4577b49783c3e424f1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:19.281574 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-9d9b9404-59c1-4527-97d0-42246ea5e5eb tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] 10.222.0.20 "GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e" status: 200 len: 1358 microversion: 2.1 time: 0.359439 Aug 09 02:42:19.294972 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 109/236] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:18 2022] GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e => generated 1358 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:19.330484 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-dcfa7d7d-efef-44bb-b9b6-3b726313ae08 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:19.338023 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-dcfa7d7d-efef-44bb-b9b6-3b726313ae08 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507" status: 200 len: 1521 microversion: 2.1 time: 0.202508 Aug 09 02:42:19.338873 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 128/237] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:19 2022] GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:19.485892 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-ac86d257-30a2-4988-ad3f-fe3a7c6f25b5 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:19.486534 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-ac86d257-30a2-4988-ad3f-fe3a7c6f25b5 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:19.493851 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ac86d257-30a2-4988-ad3f-fe3a7c6f25b5 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:19.494403 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ac86d257-30a2-4988-ad3f-fe3a7c6f25b5 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:19.495048 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ac86d257-30a2-4988-ad3f-fe3a7c6f25b5 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:19.496004 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ac86d257-30a2-4988-ad3f-fe3a7c6f25b5 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:19.496658 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ac86d257-30a2-4988-ad3f-fe3a7c6f25b5 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:19.497138 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ac86d257-30a2-4988-ad3f-fe3a7c6f25b5 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:19.569475 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-ac86d257-30a2-4988-ad3f-fe3a7c6f25b5 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:19.579505 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-ac86d257-30a2-4988-ad3f-fe3a7c6f25b5 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:19.580986 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-ac86d257-30a2-4988-ad3f-fe3a7c6f25b5 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:19.582073 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-ac86d257-30a2-4988-ad3f-fe3a7c6f25b5 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1334 microversion: 2.20 time: 0.100406 Aug 09 02:42:19.592615 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 110/238] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:42:19 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1334 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:42:20.302638 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-ced3d261-021b-4b04-bf8f-a30ab9ee1a67 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:20.303960 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-ced3d261-021b-4b04-bf8f-a30ab9ee1a67 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] [instance: 7cfae5d5-8846-4c6d-8e56-5a52f817b48e] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:20.318316 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ced3d261-021b-4b04-bf8f-a30ab9ee1a67 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:20.319050 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ced3d261-021b-4b04-bf8f-a30ab9ee1a67 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:20.319870 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ced3d261-021b-4b04-bf8f-a30ab9ee1a67 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:20.320849 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ced3d261-021b-4b04-bf8f-a30ab9ee1a67 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:20.321552 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ced3d261-021b-4b04-bf8f-a30ab9ee1a67 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:20.322709 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ced3d261-021b-4b04-bf8f-a30ab9ee1a67 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:20.360423 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-5bf436e4-1e04-40a2-a70f-c0d20e87f2ea tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:20.361017 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-5bf436e4-1e04-40a2-a70f-c0d20e87f2ea tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:20.370015 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-5bf436e4-1e04-40a2-a70f-c0d20e87f2ea tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:20.370521 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-5bf436e4-1e04-40a2-a70f-c0d20e87f2ea tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:20.370946 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-5bf436e4-1e04-40a2-a70f-c0d20e87f2ea tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:20.371651 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-5bf436e4-1e04-40a2-a70f-c0d20e87f2ea tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:20.372097 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-5bf436e4-1e04-40a2-a70f-c0d20e87f2ea tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:20.372518 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-5bf436e4-1e04-40a2-a70f-c0d20e87f2ea tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:20.724735 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-5bf436e4-1e04-40a2-a70f-c0d20e87f2ea tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:20.733403 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-5bf436e4-1e04-40a2-a70f-c0d20e87f2ea tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507" status: 200 len: 1521 microversion: 2.1 time: 0.376914 Aug 09 02:42:20.748280 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 111/239] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:20 2022] GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507 => generated 1521 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:20.753867 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-577d6d94-2e37-459a-8561-dab3c522303d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:20.754532 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-577d6d94-2e37-459a-8561-dab3c522303d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:20.761745 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-577d6d94-2e37-459a-8561-dab3c522303d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:20.762545 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-577d6d94-2e37-459a-8561-dab3c522303d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:20.763136 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-577d6d94-2e37-459a-8561-dab3c522303d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:20.764055 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-577d6d94-2e37-459a-8561-dab3c522303d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:20.765219 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-577d6d94-2e37-459a-8561-dab3c522303d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:20.766510 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-577d6d94-2e37-459a-8561-dab3c522303d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:20.766954 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_cell0:SELECT=2 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:42:20.833649 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-ced3d261-021b-4b04-bf8f-a30ab9ee1a67 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6b64eb434414ab61f19b170385c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5508bdf5e4577b49783c3e424f1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:20.844538 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-ced3d261-021b-4b04-bf8f-a30ab9ee1a67 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] 10.222.0.20 "GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e" status: 200 len: 1358 microversion: 2.1 time: 0.546259 Aug 09 02:42:20.845795 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 129/240] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:20 2022] GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e => generated 1358 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:20.870690 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-577d6d94-2e37-459a-8561-dab3c522303d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:20.887962 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-577d6d94-2e37-459a-8561-dab3c522303d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:20.889587 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-577d6d94-2e37-459a-8561-dab3c522303d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:20.890808 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-577d6d94-2e37-459a-8561-dab3c522303d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1340 microversion: 2.20 time: 0.141312 Aug 09 02:42:20.891528 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 112/241] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:42:20 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1340 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:42:21.754673 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-6a8d6ce2-9df5-47e2-8a0c-a723673e9c45 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:21.756266 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-6a8d6ce2-9df5-47e2-8a0c-a723673e9c45 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:21.763040 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6a8d6ce2-9df5-47e2-8a0c-a723673e9c45 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:21.763532 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6a8d6ce2-9df5-47e2-8a0c-a723673e9c45 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:21.764823 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6a8d6ce2-9df5-47e2-8a0c-a723673e9c45 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:21.765537 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6a8d6ce2-9df5-47e2-8a0c-a723673e9c45 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:21.765997 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6a8d6ce2-9df5-47e2-8a0c-a723673e9c45 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:21.766475 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6a8d6ce2-9df5-47e2-8a0c-a723673e9c45 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:21.876623 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-3115d8ae-db39-4cfc-86b3-ad7f7a584218 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:21.877690 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-3115d8ae-db39-4cfc-86b3-ad7f7a584218 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] [instance: 7cfae5d5-8846-4c6d-8e56-5a52f817b48e] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:21.882279 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_cell0:SELECT=8 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:42:21.907263 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3115d8ae-db39-4cfc-86b3-ad7f7a584218 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:21.908876 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3115d8ae-db39-4cfc-86b3-ad7f7a584218 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:21.912744 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3115d8ae-db39-4cfc-86b3-ad7f7a584218 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:21.915395 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3115d8ae-db39-4cfc-86b3-ad7f7a584218 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:21.919385 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3115d8ae-db39-4cfc-86b3-ad7f7a584218 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:21.921486 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3115d8ae-db39-4cfc-86b3-ad7f7a584218 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:22.137517 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-6a8d6ce2-9df5-47e2-8a0c-a723673e9c45 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:22.150925 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-6a8d6ce2-9df5-47e2-8a0c-a723673e9c45 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507" status: 200 len: 1521 microversion: 2.1 time: 0.396604 Aug 09 02:42:22.152460 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 130/242] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:21 2022] GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507 => generated 1521 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:22.157260 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-0de1340d-f61d-4b95-9c48-91ebe1d1cc97 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:22.157866 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-0de1340d-f61d-4b95-9c48-91ebe1d1cc97 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:22.174046 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0de1340d-f61d-4b95-9c48-91ebe1d1cc97 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:22.174781 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0de1340d-f61d-4b95-9c48-91ebe1d1cc97 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:22.175373 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0de1340d-f61d-4b95-9c48-91ebe1d1cc97 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:22.176261 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0de1340d-f61d-4b95-9c48-91ebe1d1cc97 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:22.176969 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0de1340d-f61d-4b95-9c48-91ebe1d1cc97 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:22.177538 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0de1340d-f61d-4b95-9c48-91ebe1d1cc97 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:22.289500 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-3115d8ae-db39-4cfc-86b3-ad7f7a584218 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6b64eb434414ab61f19b170385c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5508bdf5e4577b49783c3e424f1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:22.300423 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-3115d8ae-db39-4cfc-86b3-ad7f7a584218 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] 10.222.0.20 "GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e" status: 200 len: 1358 microversion: 2.1 time: 0.436270 Aug 09 02:42:22.302759 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 113/243] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:21 2022] GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e => generated 1358 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:22.406141 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-0de1340d-f61d-4b95-9c48-91ebe1d1cc97 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:22.408896 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_cell1:SELECT=100 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:42:22.417179 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-0de1340d-f61d-4b95-9c48-91ebe1d1cc97 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:22.424079 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-0de1340d-f61d-4b95-9c48-91ebe1d1cc97 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:22.425510 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-0de1340d-f61d-4b95-9c48-91ebe1d1cc97 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1408 microversion: 2.20 time: 0.272019 Aug 09 02:42:22.438968 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 131/244] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:42:22 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1408 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:42:23.172295 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-ed5e42e0-276a-4ac2-a585-18a98ea61156 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:23.172915 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-ed5e42e0-276a-4ac2-a585-18a98ea61156 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:23.179776 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ed5e42e0-276a-4ac2-a585-18a98ea61156 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:23.180271 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ed5e42e0-276a-4ac2-a585-18a98ea61156 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:23.180732 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ed5e42e0-276a-4ac2-a585-18a98ea61156 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:23.181433 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ed5e42e0-276a-4ac2-a585-18a98ea61156 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:23.181879 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ed5e42e0-276a-4ac2-a585-18a98ea61156 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:23.182499 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ed5e42e0-276a-4ac2-a585-18a98ea61156 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:23.329376 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-ed5e42e0-276a-4ac2-a585-18a98ea61156 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:23.335893 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-3835bf79-8b21-4400-b2bc-410595f33efa tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:23.337115 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-3835bf79-8b21-4400-b2bc-410595f33efa tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] [instance: 7cfae5d5-8846-4c6d-8e56-5a52f817b48e] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:23.337945 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-ed5e42e0-276a-4ac2-a585-18a98ea61156 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507" status: 200 len: 1501 microversion: 2.1 time: 0.169598 Aug 09 02:42:23.338662 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 114/245] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:23 2022] GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507 => generated 1501 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:23.351439 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3835bf79-8b21-4400-b2bc-410595f33efa tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:23.352123 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3835bf79-8b21-4400-b2bc-410595f33efa tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:23.352743 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3835bf79-8b21-4400-b2bc-410595f33efa tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:23.353433 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3835bf79-8b21-4400-b2bc-410595f33efa tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:23.354026 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3835bf79-8b21-4400-b2bc-410595f33efa tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:23.354613 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3835bf79-8b21-4400-b2bc-410595f33efa tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:23.360299 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-8331ed42-48e3-4741-9515-f33902859308 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:23.361177 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-8331ed42-48e3-4741-9515-f33902859308 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: a587f99c-5ad7-4fa2-945e-06954d45d44d] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:23.367944 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8331ed42-48e3-4741-9515-f33902859308 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:23.368676 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8331ed42-48e3-4741-9515-f33902859308 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:23.369312 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8331ed42-48e3-4741-9515-f33902859308 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:23.370232 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8331ed42-48e3-4741-9515-f33902859308 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:23.370870 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8331ed42-48e3-4741-9515-f33902859308 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:23.371464 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8331ed42-48e3-4741-9515-f33902859308 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:23.587553 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-3835bf79-8b21-4400-b2bc-410595f33efa tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6b64eb434414ab61f19b170385c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5508bdf5e4577b49783c3e424f1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:23.594523 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-8331ed42-48e3-4741-9515-f33902859308 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:23.595888 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-3835bf79-8b21-4400-b2bc-410595f33efa tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] 10.222.0.20 "GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e" status: 200 len: 1358 microversion: 2.1 time: 0.274635 Aug 09 02:42:23.598507 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 132/246] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:23 2022] GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e => generated 1358 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:42:23.603394 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-8331ed42-48e3-4741-9515-f33902859308 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d" status: 200 len: 1515 microversion: 2.1 time: 0.246947 Aug 09 02:42:23.604534 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 115/247] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:23 2022] GET /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d => generated 1515 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:42:23.605805 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-0b6736a7-f168-4fcc-b762-31bfa29ca734 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:23.606625 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-0b6736a7-f168-4fcc-b762-31bfa29ca734 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:23.612859 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0b6736a7-f168-4fcc-b762-31bfa29ca734 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:23.613682 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0b6736a7-f168-4fcc-b762-31bfa29ca734 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:23.614390 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0b6736a7-f168-4fcc-b762-31bfa29ca734 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:23.615286 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0b6736a7-f168-4fcc-b762-31bfa29ca734 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:23.615839 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0b6736a7-f168-4fcc-b762-31bfa29ca734 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:23.616358 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0b6736a7-f168-4fcc-b762-31bfa29ca734 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:23.726864 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [req-716e4519-0f9d-48b6-912b-53d793f544b1 req-0b65909a-2c1d-4917-870a-cc60840aee54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9919dd32-c9e0-42ae-8981-414c2e663e73", "tag": "e32a0be8-e008-4397-89d0-66d5a85e0515"}]} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:42:23.740001 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-716e4519-0f9d-48b6-912b-53d793f544b1 req-0b65909a-2c1d-4917-870a-cc60840aee54 service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:23.740639 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-716e4519-0f9d-48b6-912b-53d793f544b1 req-0b65909a-2c1d-4917-870a-cc60840aee54 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:23.741200 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-716e4519-0f9d-48b6-912b-53d793f544b1 req-0b65909a-2c1d-4917-870a-cc60840aee54 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:23.762197 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.compute.server_external_events [req-716e4519-0f9d-48b6-912b-53d793f544b1 req-0b65909a-2c1d-4917-870a-cc60840aee54 service nova] Creating event network-changed:e32a0be8-e008-4397-89d0-66d5a85e0515 for instance 9919dd32-c9e0-42ae-8981-414c2e663e73 on hv-cinder-85246 Aug 09 02:42:23.771196 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [req-716e4519-0f9d-48b6-912b-53d793f544b1 req-0b65909a-2c1d-4917-870a-cc60840aee54 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048279 Aug 09 02:42:23.772786 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 116/248] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:42:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:42:23.776166 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-0b6736a7-f168-4fcc-b762-31bfa29ca734 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:23.801153 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-0b6736a7-f168-4fcc-b762-31bfa29ca734 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:23.804086 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-0b6736a7-f168-4fcc-b762-31bfa29ca734 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:23.808397 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-0b6736a7-f168-4fcc-b762-31bfa29ca734 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1408 microversion: 2.20 time: 0.206779 Aug 09 02:42:23.820274 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 133/249] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:42:23 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1408 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:42:24.618282 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-c897f778-77cb-4d49-b4ef-b9d40ad6777e tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:24.618882 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-c897f778-77cb-4d49-b4ef-b9d40ad6777e tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] [instance: 7cfae5d5-8846-4c6d-8e56-5a52f817b48e] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:24.625205 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c897f778-77cb-4d49-b4ef-b9d40ad6777e tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:24.625649 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c897f778-77cb-4d49-b4ef-b9d40ad6777e tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:24.626071 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c897f778-77cb-4d49-b4ef-b9d40ad6777e tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:24.626873 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c897f778-77cb-4d49-b4ef-b9d40ad6777e tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:24.634247 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c897f778-77cb-4d49-b4ef-b9d40ad6777e tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:24.634247 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c897f778-77cb-4d49-b4ef-b9d40ad6777e tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:24.804770 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-c897f778-77cb-4d49-b4ef-b9d40ad6777e tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6b64eb434414ab61f19b170385c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5508bdf5e4577b49783c3e424f1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:24.814563 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-c897f778-77cb-4d49-b4ef-b9d40ad6777e tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] 10.222.0.20 "GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e" status: 200 len: 1358 microversion: 2.1 time: 0.200780 Aug 09 02:42:24.827299 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 117/250] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:24 2022] GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e => generated 1358 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:24.834278 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-87353309-b676-4ac6-8f5b-f5304d5fcb05 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:24.835115 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-87353309-b676-4ac6-8f5b-f5304d5fcb05 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:24.841413 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-87353309-b676-4ac6-8f5b-f5304d5fcb05 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:24.841989 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-87353309-b676-4ac6-8f5b-f5304d5fcb05 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:24.842513 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-87353309-b676-4ac6-8f5b-f5304d5fcb05 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:24.843284 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-87353309-b676-4ac6-8f5b-f5304d5fcb05 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:24.843805 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-87353309-b676-4ac6-8f5b-f5304d5fcb05 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:24.844416 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-87353309-b676-4ac6-8f5b-f5304d5fcb05 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:24.994200 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-87353309-b676-4ac6-8f5b-f5304d5fcb05 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:25.003062 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-87353309-b676-4ac6-8f5b-f5304d5fcb05 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:25.004390 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-87353309-b676-4ac6-8f5b-f5304d5fcb05 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:25.005904 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-87353309-b676-4ac6-8f5b-f5304d5fcb05 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1408 microversion: 2.20 time: 0.175486 Aug 09 02:42:25.006826 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 134/251] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:42:24 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1408 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:42:25.841105 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-f4da7b80-a1cd-448f-ae5a-3958db14eae0 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:25.848269 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-f4da7b80-a1cd-448f-ae5a-3958db14eae0 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] [instance: 7cfae5d5-8846-4c6d-8e56-5a52f817b48e] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:25.865981 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f4da7b80-a1cd-448f-ae5a-3958db14eae0 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:25.871329 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f4da7b80-a1cd-448f-ae5a-3958db14eae0 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:25.871813 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f4da7b80-a1cd-448f-ae5a-3958db14eae0 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:25.876002 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f4da7b80-a1cd-448f-ae5a-3958db14eae0 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:25.877929 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f4da7b80-a1cd-448f-ae5a-3958db14eae0 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:25.878494 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f4da7b80-a1cd-448f-ae5a-3958db14eae0 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:25.957739 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [req-d2bdb2b2-4fc6-47ba-b642-06d505db217f req-4d56a88a-8877-494a-afe3-bfe7e42d3f58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cfae5d5-8846-4c6d-8e56-5a52f817b48e", "name": "network-vif-plugged", "status": "completed", "tag": "e3bd4b2e-303f-4020-9be9-d72af9307f8a"}]} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:42:25.977668 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-d2bdb2b2-4fc6-47ba-b642-06d505db217f req-4d56a88a-8877-494a-afe3-bfe7e42d3f58 service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:25.978445 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-d2bdb2b2-4fc6-47ba-b642-06d505db217f req-4d56a88a-8877-494a-afe3-bfe7e42d3f58 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:25.979023 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-d2bdb2b2-4fc6-47ba-b642-06d505db217f req-4d56a88a-8877-494a-afe3-bfe7e42d3f58 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:26.029585 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.compute.server_external_events [req-d2bdb2b2-4fc6-47ba-b642-06d505db217f req-4d56a88a-8877-494a-afe3-bfe7e42d3f58 service nova] Creating event network-vif-plugged:e3bd4b2e-303f-4020-9be9-d72af9307f8a for instance 7cfae5d5-8846-4c6d-8e56-5a52f817b48e on hv-cinder-85246 Aug 09 02:42:26.035833 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [req-d2bdb2b2-4fc6-47ba-b642-06d505db217f req-4d56a88a-8877-494a-afe3-bfe7e42d3f58 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081721 Aug 09 02:42:26.036946 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 135/252] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:42:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 02:42:26.043601 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-3732f971-040c-47ec-80e1-5d3d9a02b84a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:26.044494 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-3732f971-040c-47ec-80e1-5d3d9a02b84a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:26.057955 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3732f971-040c-47ec-80e1-5d3d9a02b84a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:26.058722 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3732f971-040c-47ec-80e1-5d3d9a02b84a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:26.059305 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3732f971-040c-47ec-80e1-5d3d9a02b84a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:26.060379 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3732f971-040c-47ec-80e1-5d3d9a02b84a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:26.061013 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3732f971-040c-47ec-80e1-5d3d9a02b84a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:26.062452 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3732f971-040c-47ec-80e1-5d3d9a02b84a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:26.116489 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-f4da7b80-a1cd-448f-ae5a-3958db14eae0 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6b64eb434414ab61f19b170385c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5508bdf5e4577b49783c3e424f1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:26.129641 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-f4da7b80-a1cd-448f-ae5a-3958db14eae0 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] 10.222.0.20 "GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e" status: 200 len: 1358 microversion: 2.1 time: 0.295298 Aug 09 02:42:26.130272 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 118/253] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:25 2022] GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e => generated 1358 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:26.236160 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-3732f971-040c-47ec-80e1-5d3d9a02b84a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:26.245425 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-3732f971-040c-47ec-80e1-5d3d9a02b84a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:26.247483 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-3732f971-040c-47ec-80e1-5d3d9a02b84a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:26.248963 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-3732f971-040c-47ec-80e1-5d3d9a02b84a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1408 microversion: 2.20 time: 0.210780 Aug 09 02:42:26.258278 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 136/254] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:42:26 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1408 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:42:27.152568 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-8a226177-5840-4ed7-9d11-a9c01a3765ae tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:27.153807 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-8a226177-5840-4ed7-9d11-a9c01a3765ae tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] [instance: 7cfae5d5-8846-4c6d-8e56-5a52f817b48e] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:27.161416 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8a226177-5840-4ed7-9d11-a9c01a3765ae tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:27.162124 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8a226177-5840-4ed7-9d11-a9c01a3765ae tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:27.162944 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8a226177-5840-4ed7-9d11-a9c01a3765ae tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:27.163801 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8a226177-5840-4ed7-9d11-a9c01a3765ae tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:27.164511 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8a226177-5840-4ed7-9d11-a9c01a3765ae tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:27.165082 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8a226177-5840-4ed7-9d11-a9c01a3765ae tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:27.275905 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-0962bf46-59e6-4d24-b3a1-7c447b67d90e tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:27.276584 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-0962bf46-59e6-4d24-b3a1-7c447b67d90e tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:27.290297 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0962bf46-59e6-4d24-b3a1-7c447b67d90e tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:27.290796 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0962bf46-59e6-4d24-b3a1-7c447b67d90e tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:27.293459 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0962bf46-59e6-4d24-b3a1-7c447b67d90e tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:27.294295 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0962bf46-59e6-4d24-b3a1-7c447b67d90e tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:27.298033 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0962bf46-59e6-4d24-b3a1-7c447b67d90e tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:27.298168 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0962bf46-59e6-4d24-b3a1-7c447b67d90e tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:27.564421 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-8a226177-5840-4ed7-9d11-a9c01a3765ae tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6b64eb434414ab61f19b170385c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5508bdf5e4577b49783c3e424f1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:27.573680 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-8a226177-5840-4ed7-9d11-a9c01a3765ae tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] 10.222.0.20 "GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e" status: 200 len: 1358 microversion: 2.1 time: 0.425924 Aug 09 02:42:27.585969 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 119/255] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:27 2022] GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e => generated 1358 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:27.590661 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-25838141-209c-4080-9977-b655988a44e2 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:42:27.596555 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-25838141-209c-4080-9977-b655988a44e2 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: a587f99c-5ad7-4fa2-945e-06954d45d44d] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:27.604119 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-25838141-209c-4080-9977-b655988a44e2 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:27.604877 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-25838141-209c-4080-9977-b655988a44e2 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:27.605920 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-25838141-209c-4080-9977-b655988a44e2 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:27.606828 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-25838141-209c-4080-9977-b655988a44e2 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:27.607434 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-25838141-209c-4080-9977-b655988a44e2 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:27.608013 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-25838141-209c-4080-9977-b655988a44e2 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:27.621560 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-0962bf46-59e6-4d24-b3a1-7c447b67d90e tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:27.632007 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-0962bf46-59e6-4d24-b3a1-7c447b67d90e tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:27.634479 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-0962bf46-59e6-4d24-b3a1-7c447b67d90e tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:27.637359 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-0962bf46-59e6-4d24-b3a1-7c447b67d90e tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1408 microversion: 2.20 time: 0.366337 Aug 09 02:42:27.639013 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 137/256] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:42:27 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1408 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 02:42:27.649784 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-a924b6d9-8afd-4a55-91aa-061065fdd647 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:27.650688 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-a924b6d9-8afd-4a55-91aa-061065fdd647 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:27.657680 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a924b6d9-8afd-4a55-91aa-061065fdd647 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:27.658721 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.objects.instance [None req-25838141-209c-4080-9977-b655988a44e2 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lazy-loading 'flavor' on Instance uuid a587f99c-5ad7-4fa2-945e-06954d45d44d {{(pid=124425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 02:42:27.659602 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a924b6d9-8afd-4a55-91aa-061065fdd647 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:27.660097 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a924b6d9-8afd-4a55-91aa-061065fdd647 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:27.660844 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a924b6d9-8afd-4a55-91aa-061065fdd647 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:27.661302 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a924b6d9-8afd-4a55-91aa-061065fdd647 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:27.661738 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a924b6d9-8afd-4a55-91aa-061065fdd647 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:27.693912 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-a924b6d9-8afd-4a55-91aa-061065fdd647 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89/ips" status: 200 len: 145 microversion: 2.1 time: 0.053337 Aug 09 02:42:27.696344 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 138/257] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Aug 9 02:42:27 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89/ips => generated 145 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:42:27.891692 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-25838141-209c-4080-9977-b655988a44e2 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "POST /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d/action" status: 200 len: 32 microversion: 2.1 time: 0.309459 Aug 09 02:42:27.910196 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 120/258] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Aug 9 02:42:27 2022] POST /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d/action => generated 32 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 02:42:27.921912 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-4ca2485e-94a0-4e75-99d3-d4e1995707c1 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:27.922985 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-4ca2485e-94a0-4e75-99d3-d4e1995707c1 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: a587f99c-5ad7-4fa2-945e-06954d45d44d] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:27.937273 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4ca2485e-94a0-4e75-99d3-d4e1995707c1 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:27.940504 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4ca2485e-94a0-4e75-99d3-d4e1995707c1 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:27.941154 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4ca2485e-94a0-4e75-99d3-d4e1995707c1 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:27.942090 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4ca2485e-94a0-4e75-99d3-d4e1995707c1 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:27.942745 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4ca2485e-94a0-4e75-99d3-d4e1995707c1 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:27.943356 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4ca2485e-94a0-4e75-99d3-d4e1995707c1 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:28.239332 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-4ca2485e-94a0-4e75-99d3-d4e1995707c1 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:28.251845 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-4ca2485e-94a0-4e75-99d3-d4e1995707c1 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d" status: 200 len: 1521 microversion: 2.1 time: 0.335034 Aug 09 02:42:28.253656 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 139/259] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:27 2022] GET /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d => generated 1521 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:28.601666 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-64d72b78-5dc0-4e84-a852-ed3455483b34 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:28.601666 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-64d72b78-5dc0-4e84-a852-ed3455483b34 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] [instance: 7cfae5d5-8846-4c6d-8e56-5a52f817b48e] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:28.617786 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-64d72b78-5dc0-4e84-a852-ed3455483b34 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:28.618380 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-64d72b78-5dc0-4e84-a852-ed3455483b34 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:28.625301 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-64d72b78-5dc0-4e84-a852-ed3455483b34 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:28.626109 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-64d72b78-5dc0-4e84-a852-ed3455483b34 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:28.626623 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-64d72b78-5dc0-4e84-a852-ed3455483b34 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:28.627053 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-64d72b78-5dc0-4e84-a852-ed3455483b34 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:28.674664 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-1dfeeeb3-7571-4b12-89b8-72f86309b2dc tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:28.674664 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-1dfeeeb3-7571-4b12-89b8-72f86309b2dc tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:28.684401 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1dfeeeb3-7571-4b12-89b8-72f86309b2dc tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:28.687225 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1dfeeeb3-7571-4b12-89b8-72f86309b2dc tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:28.687866 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1dfeeeb3-7571-4b12-89b8-72f86309b2dc tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:28.688723 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1dfeeeb3-7571-4b12-89b8-72f86309b2dc tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:28.694755 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1dfeeeb3-7571-4b12-89b8-72f86309b2dc tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:28.695418 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1dfeeeb3-7571-4b12-89b8-72f86309b2dc tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:29.013348 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-64d72b78-5dc0-4e84-a852-ed3455483b34 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6b64eb434414ab61f19b170385c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5508bdf5e4577b49783c3e424f1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:29.022582 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-64d72b78-5dc0-4e84-a852-ed3455483b34 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] 10.222.0.20 "GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e" status: 200 len: 1358 microversion: 2.1 time: 0.427376 Aug 09 02:42:29.023335 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 121/260] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:28 2022] GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e => generated 1358 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:29.027829 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-1dfeeeb3-7571-4b12-89b8-72f86309b2dc tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:29.030907 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-53460cf4-7607-4a03-9774-7659dc9bcf82 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Action: 'create', calling method: .version_select at 0x7fb0a11121f0>, body: {"keypair": {"name": "tempest-keypair-330028877", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKQClID8K0tts/W0qTL+UqnfkFqEswluKRsoA1a7cPcGc4YzXFSxggogYMd3lBcx57WW00icez5S9fNdKDVJMEHyKrc0HkpxeCIhm9nkrcDaYQpOAEnQQ6qw6Y0G2QiZaw=="}} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:42:29.037889 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-1dfeeeb3-7571-4b12-89b8-72f86309b2dc tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:29.040850 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-1dfeeeb3-7571-4b12-89b8-72f86309b2dc tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:29.042411 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-1dfeeeb3-7571-4b12-89b8-72f86309b2dc tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1408 microversion: 2.20 time: 0.380449 Aug 09 02:42:29.043427 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 140/261] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:42:28 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1408 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:42:29.079276 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.quota [None req-53460cf4-7607-4a03-9774-7659dc9bcf82 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Getting quotas for project 8ce26c854fc24cadb2be5ebd441b8f3a. Resources: {'key_pairs'} {{(pid=124425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 02:42:29.089057 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.quota [None req-53460cf4-7607-4a03-9774-7659dc9bcf82 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Getting quotas for user 43232b9b191047f9a3e6ebab7ad36f02 and project 8ce26c854fc24cadb2be5ebd441b8f3a. Resources: {'key_pairs'} {{(pid=124425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 02:42:29.139086 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-53460cf4-7607-4a03-9774-7659dc9bcf82 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.112283 Aug 09 02:42:29.139746 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 122/262] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Aug 9 02:42:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:42:29.277488 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-602beeb4-a524-4030-bb6d-d878b67e9a6e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:29.279959 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-602beeb4-a524-4030-bb6d-d878b67e9a6e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: a587f99c-5ad7-4fa2-945e-06954d45d44d] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:29.299246 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-602beeb4-a524-4030-bb6d-d878b67e9a6e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:29.300264 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-602beeb4-a524-4030-bb6d-d878b67e9a6e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:29.301318 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-602beeb4-a524-4030-bb6d-d878b67e9a6e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:29.302544 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-602beeb4-a524-4030-bb6d-d878b67e9a6e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:29.303222 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-602beeb4-a524-4030-bb6d-d878b67e9a6e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:29.304082 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-602beeb4-a524-4030-bb6d-d878b67e9a6e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:29.513724 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-602beeb4-a524-4030-bb6d-d878b67e9a6e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:29.524177 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-602beeb4-a524-4030-bb6d-d878b67e9a6e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d" status: 200 len: 1521 microversion: 2.1 time: 0.251833 Aug 09 02:42:29.539104 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 141/263] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:29 2022] GET /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d => generated 1521 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:30.044698 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-c25f38b2-84c6-44e0-aa89-1cf559c77fbe tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:30.045468 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-c25f38b2-84c6-44e0-aa89-1cf559c77fbe tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] [instance: 7cfae5d5-8846-4c6d-8e56-5a52f817b48e] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:30.049078 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=4 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:42:30.068262 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-55302507-b78a-410f-b361-a8d496471fae tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:30.068882 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-55302507-b78a-410f-b361-a8d496471fae tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:30.081029 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c25f38b2-84c6-44e0-aa89-1cf559c77fbe tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:30.086928 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c25f38b2-84c6-44e0-aa89-1cf559c77fbe tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:30.088208 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-55302507-b78a-410f-b361-a8d496471fae tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:30.091055 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-55302507-b78a-410f-b361-a8d496471fae tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:30.092360 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c25f38b2-84c6-44e0-aa89-1cf559c77fbe tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:30.092360 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c25f38b2-84c6-44e0-aa89-1cf559c77fbe tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:30.093199 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-55302507-b78a-410f-b361-a8d496471fae tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:30.094497 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-55302507-b78a-410f-b361-a8d496471fae tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:30.095090 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c25f38b2-84c6-44e0-aa89-1cf559c77fbe tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:30.097895 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-55302507-b78a-410f-b361-a8d496471fae tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:30.098224 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c25f38b2-84c6-44e0-aa89-1cf559c77fbe tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:30.099378 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-55302507-b78a-410f-b361-a8d496471fae tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:31.035806 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-c25f38b2-84c6-44e0-aa89-1cf559c77fbe tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6b64eb434414ab61f19b170385c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5508bdf5e4577b49783c3e424f1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:31.043848 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-c25f38b2-84c6-44e0-aa89-1cf559c77fbe tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] 10.222.0.20 "GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e" status: 200 len: 1546 microversion: 2.1 time: 1.003285 Aug 09 02:42:31.057267 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 123/264] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:30 2022] GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e => generated 1546 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:31.077767 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-55302507-b78a-410f-b361-a8d496471fae tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:31.085168 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-eea2bdfd-0c96-4cbf-b080-498324aedb4d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:31.092107 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-55302507-b78a-410f-b361-a8d496471fae tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:31.094146 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-eea2bdfd-0c96-4cbf-b080-498324aedb4d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: a587f99c-5ad7-4fa2-945e-06954d45d44d] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:31.094597 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-55302507-b78a-410f-b361-a8d496471fae tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:31.098348 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-55302507-b78a-410f-b361-a8d496471fae tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1408 microversion: 2.20 time: 1.035995 Aug 09 02:42:31.100144 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 142/265] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:42:30 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1408 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 02:42:31.108430 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-510a34fe-769c-4ee4-8378-08d7766f2996 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:31.111042 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-eea2bdfd-0c96-4cbf-b080-498324aedb4d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:31.111732 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-eea2bdfd-0c96-4cbf-b080-498324aedb4d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:31.112566 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-510a34fe-769c-4ee4-8378-08d7766f2996 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] [instance: 7cfae5d5-8846-4c6d-8e56-5a52f817b48e] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:31.113231 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-eea2bdfd-0c96-4cbf-b080-498324aedb4d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:31.114118 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-eea2bdfd-0c96-4cbf-b080-498324aedb4d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:31.117356 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-eea2bdfd-0c96-4cbf-b080-498324aedb4d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:31.117983 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-eea2bdfd-0c96-4cbf-b080-498324aedb4d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:31.127415 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-510a34fe-769c-4ee4-8378-08d7766f2996 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:31.129604 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-510a34fe-769c-4ee4-8378-08d7766f2996 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:31.130250 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-510a34fe-769c-4ee4-8378-08d7766f2996 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:31.138250 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-510a34fe-769c-4ee4-8378-08d7766f2996 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:31.138917 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-510a34fe-769c-4ee4-8378-08d7766f2996 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:31.139884 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-510a34fe-769c-4ee4-8378-08d7766f2996 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:31.656228 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-eea2bdfd-0c96-4cbf-b080-498324aedb4d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:31.658739 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:42:31.668813 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-eea2bdfd-0c96-4cbf-b080-498324aedb4d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d" status: 200 len: 1521 microversion: 2.1 time: 0.610325 Aug 09 02:42:31.683514 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-510a34fe-769c-4ee4-8378-08d7766f2996 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6b64eb434414ab61f19b170385c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5508bdf5e4577b49783c3e424f1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:31.683923 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 124/266] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:31 2022] GET /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d => generated 1521 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:31.691781 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-510a34fe-769c-4ee4-8378-08d7766f2996 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] 10.222.0.20 "GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e" status: 200 len: 1546 microversion: 2.1 time: 0.590171 Aug 09 02:42:31.692539 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 143/267] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:31 2022] GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e => generated 1546 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:31.695494 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-3f65d908-941b-48eb-ae4b-3584f0487448 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "12777bd2-4a05-4fb8-9bab-c2992be73535"}} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:42:31.699655 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-3f65d908-941b-48eb-ae4b-3584f0487448 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:31.716953 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-409ac1e0-d468-4121-808e-d6a51834d365 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:31.719736 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3f65d908-941b-48eb-ae4b-3584f0487448 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:31.720413 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3f65d908-941b-48eb-ae4b-3584f0487448 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:31.721679 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3f65d908-941b-48eb-ae4b-3584f0487448 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:31.724037 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3f65d908-941b-48eb-ae4b-3584f0487448 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:31.724651 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3f65d908-941b-48eb-ae4b-3584f0487448 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:31.724774 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-409ac1e0-d468-4121-808e-d6a51834d365 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f6d6b64eb434414ab61f19b170385c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5508bdf5e4577b49783c3e424f1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:31.725661 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-409ac1e0-d468-4121-808e-d6a51834d365 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Searching by: {'deleted': False, 'project_id': 'f0a5508bdf5e4577b49783c3e424f1ee'} {{(pid=124427) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 02:42:31.726290 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3f65d908-941b-48eb-ae4b-3584f0487448 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:31.738810 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-409ac1e0-d468-4121-808e-d6a51834d365 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:31.739549 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-409ac1e0-d468-4121-808e-d6a51834d365 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:31.740498 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-409ac1e0-d468-4121-808e-d6a51834d365 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:31.744423 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-409ac1e0-d468-4121-808e-d6a51834d365 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:31.745182 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-409ac1e0-d468-4121-808e-d6a51834d365 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:31.745771 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-409ac1e0-d468-4121-808e-d6a51834d365 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:31.909914 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.multi_cell_list [None req-409ac1e0-d468-4121-808e-d6a51834d365 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124427) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 02:42:32.102100 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-409ac1e0-d468-4121-808e-d6a51834d365 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.391550 Aug 09 02:42:32.103905 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 144/268] 10.222.0.20 () {58 vars in 1125 bytes} [Tue Aug 9 02:42:31 2022] GET /compute/v2.1/servers => generated 343 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:42:32.110801 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-5eefa580-8e20-440c-bbe2-bf2a0cb6fb6b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1001306465", "imageRef": "04a06944-b2a8-4a65-b2a6-7ed3ff18a627", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6bf516e7-9ea4-4f2e-9b3b-a70a745206d7"}], "security_groups": [{"name": "tempest-securitygroup--281766705"}], "key_name": "tempest-keypair-330028877", "user_data": "}} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:42:32.262754 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-3f65d908-941b-48eb-ae4b-3584f0487448 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "POST /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.577287 Aug 09 02:42:32.264769 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 125/269] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Aug 9 02:42:31 2022] POST /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89/os-volume_attachments => generated 194 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:42:32.278961 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-4e11e876-8a88-4bc2-a50c-6482cb0aad60 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:32.280697 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-4e11e876-8a88-4bc2-a50c-6482cb0aad60 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] [instance: 7cfae5d5-8846-4c6d-8e56-5a52f817b48e] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:32.311814 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4e11e876-8a88-4bc2-a50c-6482cb0aad60 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:32.319185 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4e11e876-8a88-4bc2-a50c-6482cb0aad60 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:32.320879 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4e11e876-8a88-4bc2-a50c-6482cb0aad60 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:32.322998 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4e11e876-8a88-4bc2-a50c-6482cb0aad60 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:32.325441 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4e11e876-8a88-4bc2-a50c-6482cb0aad60 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:32.326110 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4e11e876-8a88-4bc2-a50c-6482cb0aad60 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:32.483479 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.network.neutron [None req-5eefa580-8e20-440c-bbe2-bf2a0cb6fb6b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] validate_networks() for [('6bf516e7-9ea4-4f2e-9b3b-a70a745206d7', None, None, None, None, None)] {{(pid=124427) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 02:42:32.670071 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-4e11e876-8a88-4bc2-a50c-6482cb0aad60 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6b64eb434414ab61f19b170385c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5508bdf5e4577b49783c3e424f1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:32.678312 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-4e11e876-8a88-4bc2-a50c-6482cb0aad60 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] 10.222.0.20 "GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e" status: 200 len: 1546 microversion: 2.1 time: 0.411420 Aug 09 02:42:32.679118 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 126/270] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:32 2022] GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e => generated 1546 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:32.701460 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-7c75bd93-8394-49fc-9d39-ea1569fb00d2 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:32.702465 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-7c75bd93-8394-49fc-9d39-ea1569fb00d2 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:32.715588 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7c75bd93-8394-49fc-9d39-ea1569fb00d2 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:32.722924 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7c75bd93-8394-49fc-9d39-ea1569fb00d2 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:32.723365 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7c75bd93-8394-49fc-9d39-ea1569fb00d2 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:32.724102 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7c75bd93-8394-49fc-9d39-ea1569fb00d2 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:32.724552 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7c75bd93-8394-49fc-9d39-ea1569fb00d2 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:32.724967 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7c75bd93-8394-49fc-9d39-ea1569fb00d2 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:33.197843 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-7c75bd93-8394-49fc-9d39-ea1569fb00d2 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:33.206460 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-7c75bd93-8394-49fc-9d39-ea1569fb00d2 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:33.214571 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-7c75bd93-8394-49fc-9d39-ea1569fb00d2 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:33.216004 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-7c75bd93-8394-49fc-9d39-ea1569fb00d2 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1408 microversion: 2.20 time: 0.524424 Aug 09 02:42:33.230256 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 127/271] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:42:32 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1408 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:42:33.230256 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-9b7253aa-32b6-49b0-8ab6-626ff25b691d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:33.230256 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-9b7253aa-32b6-49b0-8ab6-626ff25b691d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: a587f99c-5ad7-4fa2-945e-06954d45d44d] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:33.250667 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9b7253aa-32b6-49b0-8ab6-626ff25b691d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:33.251142 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9b7253aa-32b6-49b0-8ab6-626ff25b691d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:33.251738 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9b7253aa-32b6-49b0-8ab6-626ff25b691d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:33.252653 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9b7253aa-32b6-49b0-8ab6-626ff25b691d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:33.253301 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9b7253aa-32b6-49b0-8ab6-626ff25b691d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:33.253919 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9b7253aa-32b6-49b0-8ab6-626ff25b691d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:33.466944 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.virt.hardware [None req-5eefa580-8e20-440c-bbe2-bf2a0cb6fb6b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Flavor limits 0:0:0 {{(pid=124427) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 02:42:33.467445 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.virt.hardware [None req-5eefa580-8e20-440c-bbe2-bf2a0cb6fb6b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Image limits 0:0:0 {{(pid=124427) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 02:42:33.467806 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.virt.hardware [None req-5eefa580-8e20-440c-bbe2-bf2a0cb6fb6b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Flavor pref 0:0:0 {{(pid=124427) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 02:42:33.468206 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.virt.hardware [None req-5eefa580-8e20-440c-bbe2-bf2a0cb6fb6b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Image pref 0:0:0 {{(pid=124427) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 02:42:33.468621 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.virt.hardware [None req-5eefa580-8e20-440c-bbe2-bf2a0cb6fb6b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124427) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 02:42:33.478446 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5eefa580-8e20-440c-bbe2-bf2a0cb6fb6b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:33.479241 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5eefa580-8e20-440c-bbe2-bf2a0cb6fb6b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:33.479682 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5eefa580-8e20-440c-bbe2-bf2a0cb6fb6b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:33.480903 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5eefa580-8e20-440c-bbe2-bf2a0cb6fb6b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:33.481533 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5eefa580-8e20-440c-bbe2-bf2a0cb6fb6b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:33.482135 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5eefa580-8e20-440c-bbe2-bf2a0cb6fb6b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:33.501250 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.quota [None req-5eefa580-8e20-440c-bbe2-bf2a0cb6fb6b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Getting quotas for project 8ce26c854fc24cadb2be5ebd441b8f3a. Resources: {'cores', 'ram', 'instances'} {{(pid=124427) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 02:42:33.505474 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.quota [None req-5eefa580-8e20-440c-bbe2-bf2a0cb6fb6b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Getting quotas for user 43232b9b191047f9a3e6ebab7ad36f02 and project 8ce26c854fc24cadb2be5ebd441b8f3a. Resources: {'cores', 'ram', 'instances'} {{(pid=124427) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 02:42:33.517245 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-5eefa580-8e20-440c-bbe2-bf2a0cb6fb6b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Going to run 1 instances... {{(pid=124427) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 02:42:33.519733 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-5eefa580-8e20-440c-bbe2-bf2a0cb6fb6b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 86989fa1-a3d2-4af9-9e2c-319ac2a8a23c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='04a06944-b2a8-4a65-b2a6-7ed3ff18a627',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124427) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 02:42:33.538665 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-9b7253aa-32b6-49b0-8ab6-626ff25b691d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:33.553950 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-9b7253aa-32b6-49b0-8ab6-626ff25b691d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d" status: 200 len: 1521 microversion: 2.1 time: 0.329586 Aug 09 02:42:33.554614 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 128/272] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:33 2022] GET /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d => generated 1521 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:33.577419 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-5eefa580-8e20-440c-bbe2-bf2a0cb6fb6b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.472186 Aug 09 02:42:33.578384 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 145/273] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Aug 9 02:42:32 2022] POST /compute/v2.1/servers => generated 401 bytes in 1474 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 02:42:33.589762 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-8eea3f3c-7062-4df6-b182-5488c918fc59 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:33.590501 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-8eea3f3c-7062-4df6-b182-5488c918fc59 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 86989fa1-a3d2-4af9-9e2c-319ac2a8a23c] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:33.691588 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-8eea3f3c-7062-4df6-b182-5488c918fc59 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:33.701293 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-8eea3f3c-7062-4df6-b182-5488c918fc59 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/86989fa1-a3d2-4af9-9e2c-319ac2a8a23c" status: 200 len: 1241 microversion: 2.1 time: 0.114806 Aug 09 02:42:33.718332 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 129/274] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:33 2022] GET /compute/v2.1/servers/86989fa1-a3d2-4af9-9e2c-319ac2a8a23c => generated 1241 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:33.877087 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [req-5c82e444-24e6-4543-ae93-d152c1da3720 req-f64588a8-2146-4cc0-b687-01b400cedb1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9919dd32-c9e0-42ae-8981-414c2e663e73", "name": "network-vif-plugged", "status": "completed", "tag": "e32a0be8-e008-4397-89d0-66d5a85e0515"}]} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:42:33.893041 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-5c82e444-24e6-4543-ae93-d152c1da3720 req-f64588a8-2146-4cc0-b687-01b400cedb1c service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:33.896988 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-5c82e444-24e6-4543-ae93-d152c1da3720 req-f64588a8-2146-4cc0-b687-01b400cedb1c service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:33.897676 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-5c82e444-24e6-4543-ae93-d152c1da3720 req-f64588a8-2146-4cc0-b687-01b400cedb1c service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:33.916567 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.compute.server_external_events [req-5c82e444-24e6-4543-ae93-d152c1da3720 req-f64588a8-2146-4cc0-b687-01b400cedb1c service nova] Creating event network-vif-plugged:e32a0be8-e008-4397-89d0-66d5a85e0515 for instance 9919dd32-c9e0-42ae-8981-414c2e663e73 on hv-cinder-85246 Aug 09 02:42:33.936121 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [req-5c82e444-24e6-4543-ae93-d152c1da3720 req-f64588a8-2146-4cc0-b687-01b400cedb1c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062541 Aug 09 02:42:33.937123 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 146/275] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:42:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:42:34.292771 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-3f624f3d-dc75-44a6-9a6a-6b6f1884659c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:34.293416 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-3f624f3d-dc75-44a6-9a6a-6b6f1884659c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:34.341982 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3f624f3d-dc75-44a6-9a6a-6b6f1884659c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:34.342505 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3f624f3d-dc75-44a6-9a6a-6b6f1884659c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:34.342935 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3f624f3d-dc75-44a6-9a6a-6b6f1884659c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:34.343629 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3f624f3d-dc75-44a6-9a6a-6b6f1884659c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:34.344063 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3f624f3d-dc75-44a6-9a6a-6b6f1884659c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:34.344473 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3f624f3d-dc75-44a6-9a6a-6b6f1884659c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:34.577285 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-08531614-bf8d-4e3b-9dde-a1eead184a7a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:34.578066 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-08531614-bf8d-4e3b-9dde-a1eead184a7a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: a587f99c-5ad7-4fa2-945e-06954d45d44d] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:34.599922 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-08531614-bf8d-4e3b-9dde-a1eead184a7a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:34.600417 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-08531614-bf8d-4e3b-9dde-a1eead184a7a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:34.600949 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-08531614-bf8d-4e3b-9dde-a1eead184a7a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:34.601865 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-08531614-bf8d-4e3b-9dde-a1eead184a7a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:34.602014 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-08531614-bf8d-4e3b-9dde-a1eead184a7a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:34.603800 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-08531614-bf8d-4e3b-9dde-a1eead184a7a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:34.914722 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-3f624f3d-dc75-44a6-9a6a-6b6f1884659c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:34.918944 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-08531614-bf8d-4e3b-9dde-a1eead184a7a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:34.928997 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-08531614-bf8d-4e3b-9dde-a1eead184a7a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d" status: 200 len: 1521 microversion: 2.1 time: 0.356061 Aug 09 02:42:34.946984 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-3f624f3d-dc75-44a6-9a6a-6b6f1884659c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:34.947829 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 147/276] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:34 2022] GET /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d => generated 1521 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:42:34.948915 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-3f624f3d-dc75-44a6-9a6a-6b6f1884659c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:34.950225 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-3f624f3d-dc75-44a6-9a6a-6b6f1884659c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1408 microversion: 2.20 time: 0.709917 Aug 09 02:42:34.950903 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 130/277] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:42:34 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1408 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:42:34.952997 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-d9e46954-cc95-4369-9b24-a03115485a5f tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0577e2d0-7dfe-44ea-8c32-cffd78a27ddf"}} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:42:34.957501 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-d66e63b9-4080-4f6e-b899-a968b162d2f2 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:34.958306 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-d9e46954-cc95-4369-9b24-a03115485a5f tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] [instance: 7cfae5d5-8846-4c6d-8e56-5a52f817b48e] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:34.958818 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-d66e63b9-4080-4f6e-b899-a968b162d2f2 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 86989fa1-a3d2-4af9-9e2c-319ac2a8a23c] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:34.971835 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d66e63b9-4080-4f6e-b899-a968b162d2f2 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:34.972036 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d9e46954-cc95-4369-9b24-a03115485a5f tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:34.972446 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d9e46954-cc95-4369-9b24-a03115485a5f tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:34.972877 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d9e46954-cc95-4369-9b24-a03115485a5f tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:34.972994 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d66e63b9-4080-4f6e-b899-a968b162d2f2 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:34.973549 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d66e63b9-4080-4f6e-b899-a968b162d2f2 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:34.973667 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d9e46954-cc95-4369-9b24-a03115485a5f tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:34.974792 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d9e46954-cc95-4369-9b24-a03115485a5f tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:34.974792 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d9e46954-cc95-4369-9b24-a03115485a5f tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:34.974969 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d66e63b9-4080-4f6e-b899-a968b162d2f2 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:34.975454 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d66e63b9-4080-4f6e-b899-a968b162d2f2 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:34.975961 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d66e63b9-4080-4f6e-b899-a968b162d2f2 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:35.043930 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-d66e63b9-4080-4f6e-b899-a968b162d2f2 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:35.060293 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-d66e63b9-4080-4f6e-b899-a968b162d2f2 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/86989fa1-a3d2-4af9-9e2c-319ac2a8a23c" status: 200 len: 1293 microversion: 2.1 time: 0.107417 Aug 09 02:42:35.061097 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 131/278] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:34 2022] GET /compute/v2.1/servers/86989fa1-a3d2-4af9-9e2c-319ac2a8a23c => generated 1293 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:35.255088 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-5d1b2a9d-a39d-4f57-8456-a629945274b8 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Action: 'create', calling method: .version_select at 0x7fb0a1020670>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-93674777", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLMEQ5hC2ASPxPpkQi8is5xM7jEZTlunnkS3sniBetocSkez1s2KAbjK5ihzV6uROZhu79c2M8zQ828YRD3aQjpAXjQyln+eii7CGhW/vQOs7TVX8/DhY4nGL0zy+U7QXQ=="}} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:42:35.272961 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.quota [None req-5d1b2a9d-a39d-4f57-8456-a629945274b8 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Getting quotas for project 9aadaf242f674436a45eae700fb52fc1. Resources: {'key_pairs'} {{(pid=124425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 02:42:35.277834 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.quota [None req-5d1b2a9d-a39d-4f57-8456-a629945274b8 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Getting quotas for user 90fa94f90d49485a81d502929bcd0b93 and project 9aadaf242f674436a45eae700fb52fc1. Resources: {'key_pairs'} {{(pid=124425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 02:42:35.302628 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-5d1b2a9d-a39d-4f57-8456-a629945274b8 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.240055 Aug 09 02:42:35.304246 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 132/279] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Aug 9 02:42:35 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:42:35.951776 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-a8c386d2-fef6-4e58-9d9c-ce03a2c22b24 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:35.952487 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-a8c386d2-fef6-4e58-9d9c-ce03a2c22b24 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: a587f99c-5ad7-4fa2-945e-06954d45d44d] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:35.960429 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a8c386d2-fef6-4e58-9d9c-ce03a2c22b24 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:35.960871 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a8c386d2-fef6-4e58-9d9c-ce03a2c22b24 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:35.961245 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a8c386d2-fef6-4e58-9d9c-ce03a2c22b24 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:35.963037 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a8c386d2-fef6-4e58-9d9c-ce03a2c22b24 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:35.963549 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a8c386d2-fef6-4e58-9d9c-ce03a2c22b24 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:35.964180 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a8c386d2-fef6-4e58-9d9c-ce03a2c22b24 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:36.228943 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-a8c386d2-fef6-4e58-9d9c-ce03a2c22b24 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:36.246519 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-a8c386d2-fef6-4e58-9d9c-ce03a2c22b24 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d" status: 200 len: 1521 microversion: 2.1 time: 0.293009 Aug 09 02:42:36.258176 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-d9e46954-cc95-4369-9b24-a03115485a5f tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] 10.222.0.20 "POST /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.308774 Aug 09 02:42:36.262571 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 148/280] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Aug 9 02:42:34 2022] POST /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e/os-volume_attachments => generated 194 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:42:36.272547 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 133/281] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:35 2022] GET /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d => generated 1521 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:36.293763 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-03c2030f-0eb5-4e4a-affa-c88acef4cb47 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:36.299519 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-d203b1b4-6f8e-4e1c-9ae2-ddef490a8388 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:36.302020 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-d203b1b4-6f8e-4e1c-9ae2-ddef490a8388 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 86989fa1-a3d2-4af9-9e2c-319ac2a8a23c] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:36.302846 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-03c2030f-0eb5-4e4a-affa-c88acef4cb47 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:36.315900 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d203b1b4-6f8e-4e1c-9ae2-ddef490a8388 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:36.316709 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d203b1b4-6f8e-4e1c-9ae2-ddef490a8388 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:36.317297 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d203b1b4-6f8e-4e1c-9ae2-ddef490a8388 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:36.319076 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d203b1b4-6f8e-4e1c-9ae2-ddef490a8388 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:36.319820 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d203b1b4-6f8e-4e1c-9ae2-ddef490a8388 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:36.320398 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d203b1b4-6f8e-4e1c-9ae2-ddef490a8388 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:36.354557 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-03c2030f-0eb5-4e4a-affa-c88acef4cb47 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:36.358648 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-03c2030f-0eb5-4e4a-affa-c88acef4cb47 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:36.359627 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-03c2030f-0eb5-4e4a-affa-c88acef4cb47 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:36.365397 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-03c2030f-0eb5-4e4a-affa-c88acef4cb47 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:36.366036 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-03c2030f-0eb5-4e4a-affa-c88acef4cb47 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:36.366607 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-03c2030f-0eb5-4e4a-affa-c88acef4cb47 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:36.415725 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:42:36.446732 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-d203b1b4-6f8e-4e1c-9ae2-ddef490a8388 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:36.464530 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-d203b1b4-6f8e-4e1c-9ae2-ddef490a8388 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/86989fa1-a3d2-4af9-9e2c-319ac2a8a23c" status: 200 len: 1299 microversion: 2.1 time: 0.167775 Aug 09 02:42:36.466473 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 134/282] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:36 2022] GET /compute/v2.1/servers/86989fa1-a3d2-4af9-9e2c-319ac2a8a23c => generated 1299 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:36.752732 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-03c2030f-0eb5-4e4a-affa-c88acef4cb47 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:36.765904 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-03c2030f-0eb5-4e4a-affa-c88acef4cb47 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:36.767466 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-03c2030f-0eb5-4e4a-affa-c88acef4cb47 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:36.768616 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-03c2030f-0eb5-4e4a-affa-c88acef4cb47 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1408 microversion: 2.20 time: 0.504378 Aug 09 02:42:36.769174 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 149/283] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:42:36 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1408 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:42:37.270582 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-61bd28c7-61ba-4233-9a8f-d14872965748 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:37.271763 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-61bd28c7-61ba-4233-9a8f-d14872965748 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: a587f99c-5ad7-4fa2-945e-06954d45d44d] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:37.289920 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-61bd28c7-61ba-4233-9a8f-d14872965748 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:37.290633 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-61bd28c7-61ba-4233-9a8f-d14872965748 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:37.291379 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-61bd28c7-61ba-4233-9a8f-d14872965748 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:37.298881 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-61bd28c7-61ba-4233-9a8f-d14872965748 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:37.299632 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-61bd28c7-61ba-4233-9a8f-d14872965748 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:37.301155 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-61bd28c7-61ba-4233-9a8f-d14872965748 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:37.496251 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-8281789d-f7a8-4308-bbce-b0b535757517 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:37.497813 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-8281789d-f7a8-4308-bbce-b0b535757517 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 86989fa1-a3d2-4af9-9e2c-319ac2a8a23c] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:37.508436 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8281789d-f7a8-4308-bbce-b0b535757517 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:37.510513 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8281789d-f7a8-4308-bbce-b0b535757517 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:37.518652 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8281789d-f7a8-4308-bbce-b0b535757517 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:37.520967 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8281789d-f7a8-4308-bbce-b0b535757517 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:37.521459 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8281789d-f7a8-4308-bbce-b0b535757517 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:37.521902 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8281789d-f7a8-4308-bbce-b0b535757517 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:37.545181 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-61bd28c7-61ba-4233-9a8f-d14872965748 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:37.555766 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-61bd28c7-61ba-4233-9a8f-d14872965748 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d" status: 200 len: 1521 microversion: 2.1 time: 0.290102 Aug 09 02:42:37.575421 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 135/284] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:37 2022] GET /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d => generated 1521 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:37.651482 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-8281789d-f7a8-4308-bbce-b0b535757517 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:37.668138 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-8281789d-f7a8-4308-bbce-b0b535757517 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/86989fa1-a3d2-4af9-9e2c-319ac2a8a23c" status: 200 len: 1299 microversion: 2.1 time: 0.176141 Aug 09 02:42:37.674254 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 150/285] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:37 2022] GET /compute/v2.1/servers/86989fa1-a3d2-4af9-9e2c-319ac2a8a23c => generated 1299 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:37.791547 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-7739ce13-95ef-4cf9-a22a-0e5d8e63ecc3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:37.792304 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-7739ce13-95ef-4cf9-a22a-0e5d8e63ecc3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:37.799230 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7739ce13-95ef-4cf9-a22a-0e5d8e63ecc3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:37.799799 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7739ce13-95ef-4cf9-a22a-0e5d8e63ecc3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:37.800316 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7739ce13-95ef-4cf9-a22a-0e5d8e63ecc3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:37.801531 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7739ce13-95ef-4cf9-a22a-0e5d8e63ecc3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:37.801951 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7739ce13-95ef-4cf9-a22a-0e5d8e63ecc3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:37.802566 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7739ce13-95ef-4cf9-a22a-0e5d8e63ecc3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:38.035049 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-7739ce13-95ef-4cf9-a22a-0e5d8e63ecc3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:38.043257 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-7739ce13-95ef-4cf9-a22a-0e5d8e63ecc3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:38.044844 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-7739ce13-95ef-4cf9-a22a-0e5d8e63ecc3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:38.046090 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-7739ce13-95ef-4cf9-a22a-0e5d8e63ecc3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1599 microversion: 2.20 time: 0.258577 Aug 09 02:42:38.046666 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 136/286] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:42:37 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1599 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:42:38.069800 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-6dc9a1aa-da2b-43d5-83d1-ebda9d663af6 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:38.070336 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-6dc9a1aa-da2b-43d5-83d1-ebda9d663af6 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:38.076894 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6dc9a1aa-da2b-43d5-83d1-ebda9d663af6 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:38.077656 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6dc9a1aa-da2b-43d5-83d1-ebda9d663af6 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:38.078062 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6dc9a1aa-da2b-43d5-83d1-ebda9d663af6 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:38.078868 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6dc9a1aa-da2b-43d5-83d1-ebda9d663af6 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:38.079852 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6dc9a1aa-da2b-43d5-83d1-ebda9d663af6 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:38.080278 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6dc9a1aa-da2b-43d5-83d1-ebda9d663af6 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:38.251732 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-6dc9a1aa-da2b-43d5-83d1-ebda9d663af6 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.181565 Aug 09 02:42:38.260248 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 151/287] 10.222.0.20 () {60 vars in 1316 bytes} [Tue Aug 9 02:42:38 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73/os-interface => generated 285 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 02:42:38.583024 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-e358b073-c1c4-4c97-886a-cbbaef450fb8 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:38.584672 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-e358b073-c1c4-4c97-886a-cbbaef450fb8 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: a587f99c-5ad7-4fa2-945e-06954d45d44d] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:38.593260 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e358b073-c1c4-4c97-886a-cbbaef450fb8 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:38.593854 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e358b073-c1c4-4c97-886a-cbbaef450fb8 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:38.594482 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e358b073-c1c4-4c97-886a-cbbaef450fb8 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:38.595446 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e358b073-c1c4-4c97-886a-cbbaef450fb8 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:38.595997 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e358b073-c1c4-4c97-886a-cbbaef450fb8 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:38.596782 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e358b073-c1c4-4c97-886a-cbbaef450fb8 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:38.692856 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-ba1adb8a-ce4a-4093-9a71-5ef0631d847d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:38.693549 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-ba1adb8a-ce4a-4093-9a71-5ef0631d847d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 86989fa1-a3d2-4af9-9e2c-319ac2a8a23c] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:38.699871 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ba1adb8a-ce4a-4093-9a71-5ef0631d847d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:38.700496 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ba1adb8a-ce4a-4093-9a71-5ef0631d847d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:38.700988 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ba1adb8a-ce4a-4093-9a71-5ef0631d847d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:38.701745 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ba1adb8a-ce4a-4093-9a71-5ef0631d847d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:38.702315 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ba1adb8a-ce4a-4093-9a71-5ef0631d847d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:38.702802 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ba1adb8a-ce4a-4093-9a71-5ef0631d847d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:39.038371 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-e358b073-c1c4-4c97-886a-cbbaef450fb8 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:39.046362 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-e358b073-c1c4-4c97-886a-cbbaef450fb8 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d" status: 200 len: 1521 microversion: 2.1 time: 0.468971 Aug 09 02:42:39.046944 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 137/288] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:38 2022] GET /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d => generated 1521 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:39.084375 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-ba1adb8a-ce4a-4093-9a71-5ef0631d847d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:39.093821 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-ba1adb8a-ce4a-4093-9a71-5ef0631d847d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/86989fa1-a3d2-4af9-9e2c-319ac2a8a23c" status: 200 len: 1366 microversion: 2.1 time: 0.405213 Aug 09 02:42:39.106732 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 152/289] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:38 2022] GET /compute/v2.1/servers/86989fa1-a3d2-4af9-9e2c-319ac2a8a23c => generated 1366 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:42:39.971327 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [req-8f5db0c1-a8f0-4248-b7ba-b41ac1caad8a req-542d7cc1-c531-4ecd-b135-b846cf15e7ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86989fa1-a3d2-4af9-9e2c-319ac2a8a23c", "tag": "96884ef6-4436-4720-ad24-268bd22eb72d"}]} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:42:39.982609 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-8f5db0c1-a8f0-4248-b7ba-b41ac1caad8a req-542d7cc1-c531-4ecd-b135-b846cf15e7ac service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:39.983775 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-8f5db0c1-a8f0-4248-b7ba-b41ac1caad8a req-542d7cc1-c531-4ecd-b135-b846cf15e7ac service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:39.984452 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-8f5db0c1-a8f0-4248-b7ba-b41ac1caad8a req-542d7cc1-c531-4ecd-b135-b846cf15e7ac service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:39.988344 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-51c1bb24-a9a4-4f69-a1ac-752de44b9731 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:42:39.997146 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.compute.server_external_events [req-8f5db0c1-a8f0-4248-b7ba-b41ac1caad8a req-542d7cc1-c531-4ecd-b135-b846cf15e7ac service nova] Creating event network-changed:96884ef6-4436-4720-ad24-268bd22eb72d for instance 86989fa1-a3d2-4af9-9e2c-319ac2a8a23c on hv-cinder-85246 Aug 09 02:42:40.003072 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [req-8f5db0c1-a8f0-4248-b7ba-b41ac1caad8a req-542d7cc1-c531-4ecd-b135-b846cf15e7ac service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044607 Aug 09 02:42:40.003690 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-51c1bb24-a9a4-4f69-a1ac-752de44b9731 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:40.004172 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 138/290] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:42:40.006330 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-51c1bb24-a9a4-4f69-a1ac-752de44b9731 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:40.006979 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-51c1bb24-a9a4-4f69-a1ac-752de44b9731 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:40.068052 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-bc10b92c-b598-4a99-9612-c2ad6530428c tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:40.069095 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-bc10b92c-b598-4a99-9612-c2ad6530428c tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: a587f99c-5ad7-4fa2-945e-06954d45d44d] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:40.075231 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-51c1bb24-a9a4-4f69-a1ac-752de44b9731 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Going to try to stop instance {{(pid=124427) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 09 02:42:40.076006 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-bc10b92c-b598-4a99-9612-c2ad6530428c tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:40.076729 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-bc10b92c-b598-4a99-9612-c2ad6530428c tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:40.077232 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-bc10b92c-b598-4a99-9612-c2ad6530428c tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:40.078003 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-bc10b92c-b598-4a99-9612-c2ad6530428c tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:40.078544 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-bc10b92c-b598-4a99-9612-c2ad6530428c tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:40.079087 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-bc10b92c-b598-4a99-9612-c2ad6530428c tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:40.129383 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-51c1bb24-a9a4-4f69-a1ac-752de44b9731 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "POST /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89/action" status: 202 len: 0 microversion: 2.1 time: 0.151127 Aug 09 02:42:40.129893 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 153/291] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Aug 9 02:42:39 2022] POST /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 02:42:40.135454 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-c8edaebe-cdf5-4cc0-9258-1014e2fba140 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:40.136362 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-c8edaebe-cdf5-4cc0-9258-1014e2fba140 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 86989fa1-a3d2-4af9-9e2c-319ac2a8a23c] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:40.143251 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-c8edaebe-cdf5-4cc0-9258-1014e2fba140 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:40.143972 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-c8edaebe-cdf5-4cc0-9258-1014e2fba140 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:40.144605 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-c8edaebe-cdf5-4cc0-9258-1014e2fba140 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:40.145797 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-c8edaebe-cdf5-4cc0-9258-1014e2fba140 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:40.145797 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-c8edaebe-cdf5-4cc0-9258-1014e2fba140 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:40.146125 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-c8edaebe-cdf5-4cc0-9258-1014e2fba140 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:40.365950 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-bc10b92c-b598-4a99-9612-c2ad6530428c tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:40.374905 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-bc10b92c-b598-4a99-9612-c2ad6530428c tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d" status: 200 len: 1521 microversion: 2.1 time: 0.311046 Aug 09 02:42:40.386253 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 139/292] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:40 2022] GET /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d => generated 1521 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:42:40.386253 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-a891532c-877a-4ec3-8c60-c9c5cec57436 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:40.386253 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-a891532c-877a-4ec3-8c60-c9c5cec57436 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:40.389637 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a891532c-877a-4ec3-8c60-c9c5cec57436 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:40.389637 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a891532c-877a-4ec3-8c60-c9c5cec57436 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:40.390118 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a891532c-877a-4ec3-8c60-c9c5cec57436 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:40.391025 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a891532c-877a-4ec3-8c60-c9c5cec57436 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:40.391497 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a891532c-877a-4ec3-8c60-c9c5cec57436 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:40.392066 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a891532c-877a-4ec3-8c60-c9c5cec57436 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:40.417985 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-c8edaebe-cdf5-4cc0-9258-1014e2fba140 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:40.426065 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-c8edaebe-cdf5-4cc0-9258-1014e2fba140 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/86989fa1-a3d2-4af9-9e2c-319ac2a8a23c" status: 200 len: 1366 microversion: 2.1 time: 0.294729 Aug 09 02:42:40.426772 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 154/293] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:40 2022] GET /compute/v2.1/servers/86989fa1-a3d2-4af9-9e2c-319ac2a8a23c => generated 1366 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:40.569570 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-a891532c-877a-4ec3-8c60-c9c5cec57436 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:40.578896 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-a891532c-877a-4ec3-8c60-c9c5cec57436 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 200 len: 1722 microversion: 2.1 time: 0.201396 Aug 09 02:42:40.579499 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 140/294] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:40 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 1722 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:41.397166 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-253913c4-7627-427a-b8e3-753c9ddbd807 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:41.397776 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-253913c4-7627-427a-b8e3-753c9ddbd807 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: a587f99c-5ad7-4fa2-945e-06954d45d44d] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:41.404798 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-253913c4-7627-427a-b8e3-753c9ddbd807 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:41.405289 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-253913c4-7627-427a-b8e3-753c9ddbd807 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:41.405699 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-253913c4-7627-427a-b8e3-753c9ddbd807 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:41.406459 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-253913c4-7627-427a-b8e3-753c9ddbd807 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:41.406879 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-253913c4-7627-427a-b8e3-753c9ddbd807 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:41.407324 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-253913c4-7627-427a-b8e3-753c9ddbd807 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:41.447197 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-20d1bd29-21d6-47d5-95a4-fc2b4f0a76da tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:41.448502 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-20d1bd29-21d6-47d5-95a4-fc2b4f0a76da tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 86989fa1-a3d2-4af9-9e2c-319ac2a8a23c] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:41.455237 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-20d1bd29-21d6-47d5-95a4-fc2b4f0a76da tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:41.455935 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-20d1bd29-21d6-47d5-95a4-fc2b4f0a76da tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:41.456593 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-20d1bd29-21d6-47d5-95a4-fc2b4f0a76da tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:41.457288 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-20d1bd29-21d6-47d5-95a4-fc2b4f0a76da tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:41.457763 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-20d1bd29-21d6-47d5-95a4-fc2b4f0a76da tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:41.458145 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-20d1bd29-21d6-47d5-95a4-fc2b4f0a76da tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:41.597896 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-253913c4-7627-427a-b8e3-753c9ddbd807 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:41.609246 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-253913c4-7627-427a-b8e3-753c9ddbd807 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d" status: 200 len: 1521 microversion: 2.1 time: 0.215782 Aug 09 02:42:41.609803 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 155/295] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:41 2022] GET /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:41.615672 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-2c635bd2-a464-4e1c-9de0-6c22a277acfd tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:41.616516 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-2c635bd2-a464-4e1c-9de0-6c22a277acfd tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:41.625150 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2c635bd2-a464-4e1c-9de0-6c22a277acfd tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:41.625897 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2c635bd2-a464-4e1c-9de0-6c22a277acfd tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:41.626566 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2c635bd2-a464-4e1c-9de0-6c22a277acfd tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:41.627372 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2c635bd2-a464-4e1c-9de0-6c22a277acfd tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:41.627881 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2c635bd2-a464-4e1c-9de0-6c22a277acfd tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:41.628360 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2c635bd2-a464-4e1c-9de0-6c22a277acfd tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:41.655737 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-20d1bd29-21d6-47d5-95a4-fc2b4f0a76da tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:41.663553 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-20d1bd29-21d6-47d5-95a4-fc2b4f0a76da tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/86989fa1-a3d2-4af9-9e2c-319ac2a8a23c" status: 200 len: 1366 microversion: 2.1 time: 0.220299 Aug 09 02:42:41.664109 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 141/296] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:41 2022] GET /compute/v2.1/servers/86989fa1-a3d2-4af9-9e2c-319ac2a8a23c => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:42:41.765558 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-2c635bd2-a464-4e1c-9de0-6c22a277acfd tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:41.773610 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-2c635bd2-a464-4e1c-9de0-6c22a277acfd tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 200 len: 1722 microversion: 2.1 time: 0.162279 Aug 09 02:42:41.774229 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 156/297] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:41 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:42.031819 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [req-524a1404-a98f-4a89-aec1-409056747f1b req-0471a1f4-8181-4ad4-986f-0b50c9a52339 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9919dd32-c9e0-42ae-8981-414c2e663e73", "tag": "e32a0be8-e008-4397-89d0-66d5a85e0515"}]} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:42:42.041733 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-524a1404-a98f-4a89-aec1-409056747f1b req-0471a1f4-8181-4ad4-986f-0b50c9a52339 service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:42.042202 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-524a1404-a98f-4a89-aec1-409056747f1b req-0471a1f4-8181-4ad4-986f-0b50c9a52339 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:42.042638 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-524a1404-a98f-4a89-aec1-409056747f1b req-0471a1f4-8181-4ad4-986f-0b50c9a52339 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:42.054206 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.compute.server_external_events [req-524a1404-a98f-4a89-aec1-409056747f1b req-0471a1f4-8181-4ad4-986f-0b50c9a52339 service nova] Creating event network-changed:e32a0be8-e008-4397-89d0-66d5a85e0515 for instance 9919dd32-c9e0-42ae-8981-414c2e663e73 on hv-cinder-85246 Aug 09 02:42:42.059224 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [req-524a1404-a98f-4a89-aec1-409056747f1b req-0471a1f4-8181-4ad4-986f-0b50c9a52339 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031085 Aug 09 02:42:42.059818 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 142/298] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:42:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:42:42.631493 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-7842bb16-1c9b-4412-ae93-e93516cfe4a5 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:42.632419 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-7842bb16-1c9b-4412-ae93-e93516cfe4a5 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: a587f99c-5ad7-4fa2-945e-06954d45d44d] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:42.639540 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7842bb16-1c9b-4412-ae93-e93516cfe4a5 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:42.640031 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7842bb16-1c9b-4412-ae93-e93516cfe4a5 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:42.640464 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7842bb16-1c9b-4412-ae93-e93516cfe4a5 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:42.641170 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7842bb16-1c9b-4412-ae93-e93516cfe4a5 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:42.641624 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7842bb16-1c9b-4412-ae93-e93516cfe4a5 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:42.642049 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7842bb16-1c9b-4412-ae93-e93516cfe4a5 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:42.685316 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-e0964abb-2c56-46b1-ab82-b0cd58bee5ca tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:42.686666 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-e0964abb-2c56-46b1-ab82-b0cd58bee5ca tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 86989fa1-a3d2-4af9-9e2c-319ac2a8a23c] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:42.693738 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e0964abb-2c56-46b1-ab82-b0cd58bee5ca tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:42.694253 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e0964abb-2c56-46b1-ab82-b0cd58bee5ca tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:42.694691 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e0964abb-2c56-46b1-ab82-b0cd58bee5ca tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:42.695394 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e0964abb-2c56-46b1-ab82-b0cd58bee5ca tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:42.695838 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e0964abb-2c56-46b1-ab82-b0cd58bee5ca tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:42.696251 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e0964abb-2c56-46b1-ab82-b0cd58bee5ca tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:42.719458 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:42:42.977291 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-7842bb16-1c9b-4412-ae93-e93516cfe4a5 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:42.985413 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-7842bb16-1c9b-4412-ae93-e93516cfe4a5 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d" status: 200 len: 1521 microversion: 2.1 time: 0.357876 Aug 09 02:42:42.986244 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 157/299] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:42 2022] GET /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d => generated 1521 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:42.990936 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-e5621458-43cf-4ad2-82a8-2cff41e89083 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:42.991544 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-e5621458-43cf-4ad2-82a8-2cff41e89083 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:42.997795 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e5621458-43cf-4ad2-82a8-2cff41e89083 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:42.998303 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e5621458-43cf-4ad2-82a8-2cff41e89083 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:42.998739 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e5621458-43cf-4ad2-82a8-2cff41e89083 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:42.999463 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e5621458-43cf-4ad2-82a8-2cff41e89083 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:43.000400 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e5621458-43cf-4ad2-82a8-2cff41e89083 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:43.000400 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e5621458-43cf-4ad2-82a8-2cff41e89083 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:43.068754 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-e0964abb-2c56-46b1-ab82-b0cd58bee5ca tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:43.078523 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-e0964abb-2c56-46b1-ab82-b0cd58bee5ca tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/86989fa1-a3d2-4af9-9e2c-319ac2a8a23c" status: 200 len: 1366 microversion: 2.1 time: 0.397369 Aug 09 02:42:43.079155 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 143/300] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:42 2022] GET /compute/v2.1/servers/86989fa1-a3d2-4af9-9e2c-319ac2a8a23c => generated 1366 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:43.491064 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_cell0:SELECT=4 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:42:43.513679 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_cell0:SELECT=6 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:42:43.544714 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-e5621458-43cf-4ad2-82a8-2cff41e89083 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:43.553362 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-e5621458-43cf-4ad2-82a8-2cff41e89083 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 200 len: 1722 microversion: 2.1 time: 0.566152 Aug 09 02:42:43.566195 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 158/301] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:42 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 1722 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:44.006352 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-7ae395b6-173d-444f-a0e0-215eaf7b5849 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:44.014732 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-7ae395b6-173d-444f-a0e0-215eaf7b5849 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: a587f99c-5ad7-4fa2-945e-06954d45d44d] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:44.022849 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7ae395b6-173d-444f-a0e0-215eaf7b5849 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:44.023373 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7ae395b6-173d-444f-a0e0-215eaf7b5849 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:44.023807 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7ae395b6-173d-444f-a0e0-215eaf7b5849 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:44.024544 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7ae395b6-173d-444f-a0e0-215eaf7b5849 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:44.024977 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7ae395b6-173d-444f-a0e0-215eaf7b5849 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:44.025393 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7ae395b6-173d-444f-a0e0-215eaf7b5849 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:44.099718 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-c40616da-22ad-468a-8e25-0e3138d3feac tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:44.100343 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-c40616da-22ad-468a-8e25-0e3138d3feac tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 86989fa1-a3d2-4af9-9e2c-319ac2a8a23c] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:44.107594 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-c40616da-22ad-468a-8e25-0e3138d3feac tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:44.108292 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-c40616da-22ad-468a-8e25-0e3138d3feac tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:44.108716 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-c40616da-22ad-468a-8e25-0e3138d3feac tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:44.109572 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-c40616da-22ad-468a-8e25-0e3138d3feac tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:44.110018 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-c40616da-22ad-468a-8e25-0e3138d3feac tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:44.110560 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-c40616da-22ad-468a-8e25-0e3138d3feac tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:44.194831 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-7ae395b6-173d-444f-a0e0-215eaf7b5849 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:44.202642 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-7ae395b6-173d-444f-a0e0-215eaf7b5849 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d" status: 200 len: 1521 microversion: 2.1 time: 0.200112 Aug 09 02:42:44.203209 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 144/302] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:44 2022] GET /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:44.260488 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-c40616da-22ad-468a-8e25-0e3138d3feac tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:44.268137 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-c40616da-22ad-468a-8e25-0e3138d3feac tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/86989fa1-a3d2-4af9-9e2c-319ac2a8a23c" status: 200 len: 1366 microversion: 2.1 time: 0.172359 Aug 09 02:42:44.268629 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 159/303] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:44 2022] GET /compute/v2.1/servers/86989fa1-a3d2-4af9-9e2c-319ac2a8a23c => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:44.575617 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-cff98e21-a202-4128-bdf1-041ce670c6c5 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:44.576243 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-cff98e21-a202-4128-bdf1-041ce670c6c5 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:44.582615 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-cff98e21-a202-4128-bdf1-041ce670c6c5 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:44.583098 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-cff98e21-a202-4128-bdf1-041ce670c6c5 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:44.583530 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-cff98e21-a202-4128-bdf1-041ce670c6c5 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:44.584212 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-cff98e21-a202-4128-bdf1-041ce670c6c5 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:44.584677 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-cff98e21-a202-4128-bdf1-041ce670c6c5 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:44.585070 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-cff98e21-a202-4128-bdf1-041ce670c6c5 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:44.729596 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-cff98e21-a202-4128-bdf1-041ce670c6c5 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:44.738356 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-cff98e21-a202-4128-bdf1-041ce670c6c5 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 200 len: 1722 microversion: 2.1 time: 0.166589 Aug 09 02:42:44.738900 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 145/304] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:44 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:45.225015 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-726b5426-99b2-4234-a74f-a005c830cd0a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:45.225583 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-726b5426-99b2-4234-a74f-a005c830cd0a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: a587f99c-5ad7-4fa2-945e-06954d45d44d] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:45.234520 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-726b5426-99b2-4234-a74f-a005c830cd0a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:45.236953 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-726b5426-99b2-4234-a74f-a005c830cd0a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:45.237486 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-726b5426-99b2-4234-a74f-a005c830cd0a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:45.238445 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-726b5426-99b2-4234-a74f-a005c830cd0a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:45.238983 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-726b5426-99b2-4234-a74f-a005c830cd0a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:45.239470 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-726b5426-99b2-4234-a74f-a005c830cd0a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:45.288935 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-edd6ed39-85ce-43a7-b479-2465bdcf3c49 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:45.290003 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-edd6ed39-85ce-43a7-b479-2465bdcf3c49 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 86989fa1-a3d2-4af9-9e2c-319ac2a8a23c] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:45.292625 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_cell0:SELECT=10 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:42:45.298650 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-edd6ed39-85ce-43a7-b479-2465bdcf3c49 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:45.299140 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-edd6ed39-85ce-43a7-b479-2465bdcf3c49 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:45.299574 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-edd6ed39-85ce-43a7-b479-2465bdcf3c49 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:45.300270 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-edd6ed39-85ce-43a7-b479-2465bdcf3c49 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:45.300727 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-edd6ed39-85ce-43a7-b479-2465bdcf3c49 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:45.301150 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-edd6ed39-85ce-43a7-b479-2465bdcf3c49 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:45.413298 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-726b5426-99b2-4234-a74f-a005c830cd0a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:45.421705 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-726b5426-99b2-4234-a74f-a005c830cd0a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d" status: 200 len: 1521 microversion: 2.1 time: 0.201779 Aug 09 02:42:45.422434 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 160/305] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:45 2022] GET /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:45.459151 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-edd6ed39-85ce-43a7-b479-2465bdcf3c49 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:45.468159 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-edd6ed39-85ce-43a7-b479-2465bdcf3c49 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/86989fa1-a3d2-4af9-9e2c-319ac2a8a23c" status: 200 len: 1366 microversion: 2.1 time: 0.183074 Aug 09 02:42:45.468783 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 146/306] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:45 2022] GET /compute/v2.1/servers/86989fa1-a3d2-4af9-9e2c-319ac2a8a23c => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:45.760636 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-240f7330-f120-4192-8f50-6516ad462f0a tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:45.761366 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-240f7330-f120-4192-8f50-6516ad462f0a tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:45.768213 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-240f7330-f120-4192-8f50-6516ad462f0a tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:45.768697 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-240f7330-f120-4192-8f50-6516ad462f0a tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:45.769122 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-240f7330-f120-4192-8f50-6516ad462f0a tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:45.769819 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-240f7330-f120-4192-8f50-6516ad462f0a tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:45.770587 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-240f7330-f120-4192-8f50-6516ad462f0a tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:45.771025 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-240f7330-f120-4192-8f50-6516ad462f0a tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:45.904371 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-240f7330-f120-4192-8f50-6516ad462f0a tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:45.912948 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-240f7330-f120-4192-8f50-6516ad462f0a tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 200 len: 1722 microversion: 2.1 time: 0.156919 Aug 09 02:42:45.913513 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 161/307] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:45 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:46.443166 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-7c025935-5015-4525-bf94-450c1dc70fe6 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:46.443782 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-7c025935-5015-4525-bf94-450c1dc70fe6 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: a587f99c-5ad7-4fa2-945e-06954d45d44d] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:46.451458 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7c025935-5015-4525-bf94-450c1dc70fe6 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:46.451971 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7c025935-5015-4525-bf94-450c1dc70fe6 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:46.452391 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7c025935-5015-4525-bf94-450c1dc70fe6 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:46.453121 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7c025935-5015-4525-bf94-450c1dc70fe6 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:46.453559 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7c025935-5015-4525-bf94-450c1dc70fe6 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:46.453970 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7c025935-5015-4525-bf94-450c1dc70fe6 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:46.489013 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-e3360ba1-256c-4247-8060-f7c1cee9e765 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:46.489586 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-e3360ba1-256c-4247-8060-f7c1cee9e765 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 86989fa1-a3d2-4af9-9e2c-319ac2a8a23c] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:46.496357 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e3360ba1-256c-4247-8060-f7c1cee9e765 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:46.496837 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e3360ba1-256c-4247-8060-f7c1cee9e765 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:46.497386 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e3360ba1-256c-4247-8060-f7c1cee9e765 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:46.498075 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e3360ba1-256c-4247-8060-f7c1cee9e765 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:46.498561 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e3360ba1-256c-4247-8060-f7c1cee9e765 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:46.498983 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e3360ba1-256c-4247-8060-f7c1cee9e765 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:46.652905 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-7c025935-5015-4525-bf94-450c1dc70fe6 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:46.660868 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-7c025935-5015-4525-bf94-450c1dc70fe6 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d" status: 200 len: 1521 microversion: 2.1 time: 0.221663 Aug 09 02:42:46.661731 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 147/308] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:46 2022] GET /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:46.677884 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-e3360ba1-256c-4247-8060-f7c1cee9e765 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:46.685687 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-e3360ba1-256c-4247-8060-f7c1cee9e765 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/86989fa1-a3d2-4af9-9e2c-319ac2a8a23c" status: 200 len: 1366 microversion: 2.1 time: 0.200618 Aug 09 02:42:46.686280 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 162/309] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:46 2022] GET /compute/v2.1/servers/86989fa1-a3d2-4af9-9e2c-319ac2a8a23c => generated 1366 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:46.936898 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-0832367c-35ab-43cd-a5c5-f650f998411e tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:46.937674 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-0832367c-35ab-43cd-a5c5-f650f998411e tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:46.945397 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0832367c-35ab-43cd-a5c5-f650f998411e tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:46.946004 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0832367c-35ab-43cd-a5c5-f650f998411e tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:46.946933 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0832367c-35ab-43cd-a5c5-f650f998411e tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:46.947744 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0832367c-35ab-43cd-a5c5-f650f998411e tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:46.948234 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0832367c-35ab-43cd-a5c5-f650f998411e tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:46.948661 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0832367c-35ab-43cd-a5c5-f650f998411e tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:47.101530 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-0832367c-35ab-43cd-a5c5-f650f998411e tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:47.111591 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-0832367c-35ab-43cd-a5c5-f650f998411e tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 200 len: 1722 microversion: 2.1 time: 0.179289 Aug 09 02:42:47.122321 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 148/310] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:46 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 1722 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:47.193886 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-98f1a98e-f1e8-40cb-9bc9-305818353f78 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:47.194614 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-98f1a98e-f1e8-40cb-9bc9-305818353f78 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] [instance: 7cfae5d5-8846-4c6d-8e56-5a52f817b48e] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:47.201743 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-98f1a98e-f1e8-40cb-9bc9-305818353f78 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:47.202689 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-98f1a98e-f1e8-40cb-9bc9-305818353f78 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:47.203552 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-98f1a98e-f1e8-40cb-9bc9-305818353f78 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:47.204731 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-98f1a98e-f1e8-40cb-9bc9-305818353f78 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:47.205520 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-98f1a98e-f1e8-40cb-9bc9-305818353f78 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:47.206289 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-98f1a98e-f1e8-40cb-9bc9-305818353f78 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:47.343733 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-98f1a98e-f1e8-40cb-9bc9-305818353f78 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6b64eb434414ab61f19b170385c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5508bdf5e4577b49783c3e424f1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:47.352353 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-98f1a98e-f1e8-40cb-9bc9-305818353f78 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] 10.222.0.20 "GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e" status: 200 len: 1592 microversion: 2.1 time: 0.162933 Aug 09 02:42:47.352925 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 163/311] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:47 2022] GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e => generated 1592 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:47.682701 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-3df00001-3dcf-4cb9-b124-d81e0d631bbe tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:47.683306 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-3df00001-3dcf-4cb9-b124-d81e0d631bbe tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: a587f99c-5ad7-4fa2-945e-06954d45d44d] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:47.689848 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3df00001-3dcf-4cb9-b124-d81e0d631bbe tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:47.690366 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3df00001-3dcf-4cb9-b124-d81e0d631bbe tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:47.690773 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3df00001-3dcf-4cb9-b124-d81e0d631bbe tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:47.691453 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3df00001-3dcf-4cb9-b124-d81e0d631bbe tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:47.691893 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3df00001-3dcf-4cb9-b124-d81e0d631bbe tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:47.692303 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3df00001-3dcf-4cb9-b124-d81e0d631bbe tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:47.706708 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-035e95cf-ffbd-4342-beee-df2b654ee8d4 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:47.708098 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-035e95cf-ffbd-4342-beee-df2b654ee8d4 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 86989fa1-a3d2-4af9-9e2c-319ac2a8a23c] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:47.714186 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-035e95cf-ffbd-4342-beee-df2b654ee8d4 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:47.714727 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-035e95cf-ffbd-4342-beee-df2b654ee8d4 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:47.715136 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-035e95cf-ffbd-4342-beee-df2b654ee8d4 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:47.715894 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-035e95cf-ffbd-4342-beee-df2b654ee8d4 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:47.716351 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-035e95cf-ffbd-4342-beee-df2b654ee8d4 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:47.716874 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-035e95cf-ffbd-4342-beee-df2b654ee8d4 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:47.968848 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-3df00001-3dcf-4cb9-b124-d81e0d631bbe tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:47.978952 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-3df00001-3dcf-4cb9-b124-d81e0d631bbe tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d" status: 200 len: 1521 microversion: 2.1 time: 0.300426 Aug 09 02:42:47.980314 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 149/312] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:47 2022] GET /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d => generated 1521 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:48.017490 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-035e95cf-ffbd-4342-beee-df2b654ee8d4 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:48.026982 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-035e95cf-ffbd-4342-beee-df2b654ee8d4 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/86989fa1-a3d2-4af9-9e2c-319ac2a8a23c" status: 200 len: 1366 microversion: 2.1 time: 0.324062 Aug 09 02:42:48.028312 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [req-1496050f-bf40-42ee-87c5-6d31343c7709 req-16d27ba1-1d17-42cd-a8e3-2cd8cf668ce2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86989fa1-a3d2-4af9-9e2c-319ac2a8a23c", "name": "network-vif-plugged", "status": "completed", "tag": "96884ef6-4436-4720-ad24-268bd22eb72d"}]} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:42:48.037859 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-1496050f-bf40-42ee-87c5-6d31343c7709 req-16d27ba1-1d17-42cd-a8e3-2cd8cf668ce2 service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:48.038642 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-1496050f-bf40-42ee-87c5-6d31343c7709 req-16d27ba1-1d17-42cd-a8e3-2cd8cf668ce2 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:48.039231 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-1496050f-bf40-42ee-87c5-6d31343c7709 req-16d27ba1-1d17-42cd-a8e3-2cd8cf668ce2 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:48.039898 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 164/313] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:47 2022] GET /compute/v2.1/servers/86989fa1-a3d2-4af9-9e2c-319ac2a8a23c => generated 1366 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:48.053950 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.compute.server_external_events [req-1496050f-bf40-42ee-87c5-6d31343c7709 req-16d27ba1-1d17-42cd-a8e3-2cd8cf668ce2 service nova] Creating event network-vif-plugged:96884ef6-4436-4720-ad24-268bd22eb72d for instance 86989fa1-a3d2-4af9-9e2c-319ac2a8a23c on hv-cinder-85246 Aug 09 02:42:48.059217 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [req-1496050f-bf40-42ee-87c5-6d31343c7709 req-16d27ba1-1d17-42cd-a8e3-2cd8cf668ce2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034851 Aug 09 02:42:48.060013 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 150/314] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:42:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 02:42:48.134109 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-292e16c7-8c8d-4d2f-a4a2-b046961d9732 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:48.134784 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-292e16c7-8c8d-4d2f-a4a2-b046961d9732 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:48.144689 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-292e16c7-8c8d-4d2f-a4a2-b046961d9732 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:48.145860 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-292e16c7-8c8d-4d2f-a4a2-b046961d9732 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:48.146356 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-292e16c7-8c8d-4d2f-a4a2-b046961d9732 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:48.147088 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-292e16c7-8c8d-4d2f-a4a2-b046961d9732 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:48.147741 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-292e16c7-8c8d-4d2f-a4a2-b046961d9732 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:48.148182 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-292e16c7-8c8d-4d2f-a4a2-b046961d9732 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:48.154327 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:42:48.469563 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-292e16c7-8c8d-4d2f-a4a2-b046961d9732 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:48.478253 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-292e16c7-8c8d-4d2f-a4a2-b046961d9732 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 200 len: 1722 microversion: 2.1 time: 0.349666 Aug 09 02:42:48.478828 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 165/315] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:48 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 1722 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:49.002222 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-405a7a48-a54f-4166-8087-16ef98b65af1 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:49.002940 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-405a7a48-a54f-4166-8087-16ef98b65af1 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: a587f99c-5ad7-4fa2-945e-06954d45d44d] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:49.009542 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-405a7a48-a54f-4166-8087-16ef98b65af1 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:49.009945 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-405a7a48-a54f-4166-8087-16ef98b65af1 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:49.010409 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-405a7a48-a54f-4166-8087-16ef98b65af1 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:49.011086 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-405a7a48-a54f-4166-8087-16ef98b65af1 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:49.011527 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-405a7a48-a54f-4166-8087-16ef98b65af1 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:49.011937 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-405a7a48-a54f-4166-8087-16ef98b65af1 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:49.048539 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-c16dcf15-0e27-4de7-a2a3-12136c93b00d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:49.049263 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-c16dcf15-0e27-4de7-a2a3-12136c93b00d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 86989fa1-a3d2-4af9-9e2c-319ac2a8a23c] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:49.056263 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-c16dcf15-0e27-4de7-a2a3-12136c93b00d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:49.057309 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-c16dcf15-0e27-4de7-a2a3-12136c93b00d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:49.057595 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-c16dcf15-0e27-4de7-a2a3-12136c93b00d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:49.058464 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-c16dcf15-0e27-4de7-a2a3-12136c93b00d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:49.058915 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-c16dcf15-0e27-4de7-a2a3-12136c93b00d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:49.059474 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-c16dcf15-0e27-4de7-a2a3-12136c93b00d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:49.554683 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-405a7a48-a54f-4166-8087-16ef98b65af1 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:49.565670 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-405a7a48-a54f-4166-8087-16ef98b65af1 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d" status: 200 len: 1521 microversion: 2.1 time: 0.568125 Aug 09 02:42:49.566242 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 151/316] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:48 2022] GET /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d => generated 1521 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:49.571651 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-c16dcf15-0e27-4de7-a2a3-12136c93b00d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:49.572008 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-8c658ae7-f571-48c4-813f-a28e614e57bb tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:49.573279 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-8c658ae7-f571-48c4-813f-a28e614e57bb tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:49.580352 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8c658ae7-f571-48c4-813f-a28e614e57bb tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:49.580834 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8c658ae7-f571-48c4-813f-a28e614e57bb tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:49.581258 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8c658ae7-f571-48c4-813f-a28e614e57bb tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:49.582078 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8c658ae7-f571-48c4-813f-a28e614e57bb tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:49.582422 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8c658ae7-f571-48c4-813f-a28e614e57bb tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:49.582821 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8c658ae7-f571-48c4-813f-a28e614e57bb tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:49.583721 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-c16dcf15-0e27-4de7-a2a3-12136c93b00d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/86989fa1-a3d2-4af9-9e2c-319ac2a8a23c" status: 200 len: 1366 microversion: 2.1 time: 0.538510 Aug 09 02:42:49.584469 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 166/317] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:49 2022] GET /compute/v2.1/servers/86989fa1-a3d2-4af9-9e2c-319ac2a8a23c => generated 1366 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:49.777525 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-8c658ae7-f571-48c4-813f-a28e614e57bb tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:49.787118 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-8c658ae7-f571-48c4-813f-a28e614e57bb tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 200 len: 1722 microversion: 2.1 time: 0.219644 Aug 09 02:42:49.787693 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 152/318] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:49 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 1722 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:49.952810 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [req-8b90db9d-1a91-4408-8ad2-caacc0711296 req-1bb7bbad-1953-4146-bd35-008e171d410f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cfae5d5-8846-4c6d-8e56-5a52f817b48e", "tag": "e3bd4b2e-303f-4020-9be9-d72af9307f8a"}]} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:42:49.962186 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:42:49.968834 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-8b90db9d-1a91-4408-8ad2-caacc0711296 req-1bb7bbad-1953-4146-bd35-008e171d410f service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:49.969344 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-8b90db9d-1a91-4408-8ad2-caacc0711296 req-1bb7bbad-1953-4146-bd35-008e171d410f service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:49.969775 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-8b90db9d-1a91-4408-8ad2-caacc0711296 req-1bb7bbad-1953-4146-bd35-008e171d410f service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:49.982111 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.compute.server_external_events [req-8b90db9d-1a91-4408-8ad2-caacc0711296 req-1bb7bbad-1953-4146-bd35-008e171d410f service nova] Creating event network-changed:e3bd4b2e-303f-4020-9be9-d72af9307f8a for instance 7cfae5d5-8846-4c6d-8e56-5a52f817b48e on hv-cinder-85246 Aug 09 02:42:49.987320 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [req-8b90db9d-1a91-4408-8ad2-caacc0711296 req-1bb7bbad-1953-4146-bd35-008e171d410f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046189 Aug 09 02:42:49.988235 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 167/319] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:42:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:42:50.593104 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-2ba817ea-3897-401f-b979-359d217c818c tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:50.593774 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-2ba817ea-3897-401f-b979-359d217c818c tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: a587f99c-5ad7-4fa2-945e-06954d45d44d] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:50.600890 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2ba817ea-3897-401f-b979-359d217c818c tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:50.601756 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2ba817ea-3897-401f-b979-359d217c818c tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:50.602654 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2ba817ea-3897-401f-b979-359d217c818c tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:50.603528 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2ba817ea-3897-401f-b979-359d217c818c tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:50.604130 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2ba817ea-3897-401f-b979-359d217c818c tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:50.604941 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2ba817ea-3897-401f-b979-359d217c818c tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:50.609069 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-d67f8681-7255-410c-989d-3a8f6c8acc11 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:50.611270 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-d67f8681-7255-410c-989d-3a8f6c8acc11 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 86989fa1-a3d2-4af9-9e2c-319ac2a8a23c] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:50.622544 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d67f8681-7255-410c-989d-3a8f6c8acc11 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:50.623586 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d67f8681-7255-410c-989d-3a8f6c8acc11 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:50.624249 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d67f8681-7255-410c-989d-3a8f6c8acc11 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:50.624999 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d67f8681-7255-410c-989d-3a8f6c8acc11 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:50.626017 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d67f8681-7255-410c-989d-3a8f6c8acc11 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:50.626773 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d67f8681-7255-410c-989d-3a8f6c8acc11 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:50.873149 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-d67f8681-7255-410c-989d-3a8f6c8acc11 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:50.874999 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-2ba817ea-3897-401f-b979-359d217c818c tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:50.883005 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-2ba817ea-3897-401f-b979-359d217c818c tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d" status: 200 len: 1521 microversion: 2.1 time: 0.299482 Aug 09 02:42:50.883873 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-d67f8681-7255-410c-989d-3a8f6c8acc11 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/86989fa1-a3d2-4af9-9e2c-319ac2a8a23c" status: 200 len: 1557 microversion: 2.1 time: 0.282400 Aug 09 02:42:50.884265 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 153/320] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:50 2022] GET /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d => generated 1521 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:50.885084 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 168/321] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:50 2022] GET /compute/v2.1/servers/86989fa1-a3d2-4af9-9e2c-319ac2a8a23c => generated 1557 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:50.910744 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-66e5a28c-21e1-4237-a224-13e83ea66776 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:50.911351 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-66e5a28c-21e1-4237-a224-13e83ea66776 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 86989fa1-a3d2-4af9-9e2c-319ac2a8a23c] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:50.913400 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-a3a2ccbe-c246-4707-8e40-0c659da607bb tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:50.914018 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-a3a2ccbe-c246-4707-8e40-0c659da607bb tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:50.919370 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-66e5a28c-21e1-4237-a224-13e83ea66776 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:50.920187 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-66e5a28c-21e1-4237-a224-13e83ea66776 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:50.921325 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-66e5a28c-21e1-4237-a224-13e83ea66776 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:50.923204 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-66e5a28c-21e1-4237-a224-13e83ea66776 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:50.924639 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-66e5a28c-21e1-4237-a224-13e83ea66776 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:50.925340 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-66e5a28c-21e1-4237-a224-13e83ea66776 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:50.932211 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a3a2ccbe-c246-4707-8e40-0c659da607bb tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:50.932699 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a3a2ccbe-c246-4707-8e40-0c659da607bb tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:50.933127 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a3a2ccbe-c246-4707-8e40-0c659da607bb tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:50.933916 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a3a2ccbe-c246-4707-8e40-0c659da607bb tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:50.934423 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a3a2ccbe-c246-4707-8e40-0c659da607bb tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:50.934914 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a3a2ccbe-c246-4707-8e40-0c659da607bb tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:51.055010 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-66e5a28c-21e1-4237-a224-13e83ea66776 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/86989fa1-a3d2-4af9-9e2c-319ac2a8a23c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.149442 Aug 09 02:42:51.062684 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 169/322] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Aug 9 02:42:50 2022] GET /compute/v2.1/servers/86989fa1-a3d2-4af9-9e2c-319ac2a8a23c/os-interface => generated 285 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 02:42:51.067430 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-cbed8ece-d9ac-4fb6-bc64-a88b3b269198 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1282670488"}} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:42:51.068355 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-cbed8ece-d9ac-4fb6-bc64-a88b3b269198 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] [instance: 7cfae5d5-8846-4c6d-8e56-5a52f817b48e] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:51.075058 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-cbed8ece-d9ac-4fb6-bc64-a88b3b269198 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:51.075584 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-cbed8ece-d9ac-4fb6-bc64-a88b3b269198 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:51.076072 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-cbed8ece-d9ac-4fb6-bc64-a88b3b269198 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:51.076789 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-cbed8ece-d9ac-4fb6-bc64-a88b3b269198 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:51.077239 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-cbed8ece-d9ac-4fb6-bc64-a88b3b269198 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:51.077659 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-cbed8ece-d9ac-4fb6-bc64-a88b3b269198 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:51.137218 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-a3a2ccbe-c246-4707-8e40-0c659da607bb tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:51.151636 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-a3a2ccbe-c246-4707-8e40-0c659da607bb tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 200 len: 1722 microversion: 2.1 time: 0.244686 Aug 09 02:42:51.152790 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 154/323] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:50 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 1722 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:51.344274 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.network.security_group_api [None req-cbed8ece-d9ac-4fb6-bc64-a88b3b269198 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Adding security group 7e19b9f8-7e81-4515-aa48-2923ab7b3de8 to port e3bd4b2e-303f-4020-9be9-d72af9307f8a Aug 09 02:42:51.905782 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-3fa1b4cd-aef3-4a57-b672-29fa7609bc23 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:51.906645 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-3fa1b4cd-aef3-4a57-b672-29fa7609bc23 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: a587f99c-5ad7-4fa2-945e-06954d45d44d] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:51.914985 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3fa1b4cd-aef3-4a57-b672-29fa7609bc23 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:51.915727 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3fa1b4cd-aef3-4a57-b672-29fa7609bc23 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:51.916427 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3fa1b4cd-aef3-4a57-b672-29fa7609bc23 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:51.917079 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3fa1b4cd-aef3-4a57-b672-29fa7609bc23 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:51.917490 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3fa1b4cd-aef3-4a57-b672-29fa7609bc23 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:51.918330 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3fa1b4cd-aef3-4a57-b672-29fa7609bc23 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:51.962735 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-cbed8ece-d9ac-4fb6-bc64-a88b3b269198 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] 10.222.0.20 "POST /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e/action" status: 202 len: 0 microversion: 2.1 time: 0.905798 Aug 09 02:42:51.963331 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 170/324] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Aug 9 02:42:51 2022] POST /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e/action => generated 0 bytes in 907 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 02:42:51.974681 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-1ff0e282-660c-489e-8256-c605e50a0abf tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:51.988484 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-1ff0e282-660c-489e-8256-c605e50a0abf tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] [instance: 7cfae5d5-8846-4c6d-8e56-5a52f817b48e] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:51.995694 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1ff0e282-660c-489e-8256-c605e50a0abf tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:51.996175 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1ff0e282-660c-489e-8256-c605e50a0abf tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:51.996625 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1ff0e282-660c-489e-8256-c605e50a0abf tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:51.997381 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1ff0e282-660c-489e-8256-c605e50a0abf tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:51.997828 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1ff0e282-660c-489e-8256-c605e50a0abf tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:51.998250 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1ff0e282-660c-489e-8256-c605e50a0abf tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:52.165847 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-3fa1b4cd-aef3-4a57-b672-29fa7609bc23 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:52.175435 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-3fa1b4cd-aef3-4a57-b672-29fa7609bc23 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d" status: 200 len: 1521 microversion: 2.1 time: 0.274521 Aug 09 02:42:52.176026 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 155/325] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:51 2022] GET /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d => generated 1521 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:52.188428 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [req-1c4a6d0b-252b-4f6c-ac11-8278e490be8e req-0048c822-697d-4bf6-bef1-c784a10d604e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cfae5d5-8846-4c6d-8e56-5a52f817b48e", "tag": "e3bd4b2e-303f-4020-9be9-d72af9307f8a"}]} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:42:52.197967 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-1c4a6d0b-252b-4f6c-ac11-8278e490be8e req-0048c822-697d-4bf6-bef1-c784a10d604e service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:52.198708 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-1c4a6d0b-252b-4f6c-ac11-8278e490be8e req-0048c822-697d-4bf6-bef1-c784a10d604e service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:52.199324 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-1c4a6d0b-252b-4f6c-ac11-8278e490be8e req-0048c822-697d-4bf6-bef1-c784a10d604e service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:52.213266 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.compute.server_external_events [req-1c4a6d0b-252b-4f6c-ac11-8278e490be8e req-0048c822-697d-4bf6-bef1-c784a10d604e service nova] Creating event network-changed:e3bd4b2e-303f-4020-9be9-d72af9307f8a for instance 7cfae5d5-8846-4c6d-8e56-5a52f817b48e on hv-cinder-85246 Aug 09 02:42:52.226779 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [req-1c4a6d0b-252b-4f6c-ac11-8278e490be8e req-0048c822-697d-4bf6-bef1-c784a10d604e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049335 Aug 09 02:42:52.228466 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 156/326] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:42:52.235562 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-e79e45d6-fa85-4ff3-84eb-10fee556f90d tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:52.236673 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-e79e45d6-fa85-4ff3-84eb-10fee556f90d tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:52.244261 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e79e45d6-fa85-4ff3-84eb-10fee556f90d tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:52.245592 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e79e45d6-fa85-4ff3-84eb-10fee556f90d tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:52.246393 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e79e45d6-fa85-4ff3-84eb-10fee556f90d tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:52.247801 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e79e45d6-fa85-4ff3-84eb-10fee556f90d tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:52.248518 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e79e45d6-fa85-4ff3-84eb-10fee556f90d tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:52.249180 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e79e45d6-fa85-4ff3-84eb-10fee556f90d tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:52.260497 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-1ff0e282-660c-489e-8256-c605e50a0abf tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6b64eb434414ab61f19b170385c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5508bdf5e4577b49783c3e424f1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:52.271951 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-1ff0e282-660c-489e-8256-c605e50a0abf tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] 10.222.0.20 "GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e" status: 200 len: 1639 microversion: 2.1 time: 0.300606 Aug 09 02:42:52.272557 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 171/327] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:51 2022] GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e => generated 1639 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:52.379792 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [req-811da054-0369-4d05-b506-37ab5ccee41e req-0c426760-cee5-4505-a4d3-b31d2f3462c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86989fa1-a3d2-4af9-9e2c-319ac2a8a23c", "tag": "96884ef6-4436-4720-ad24-268bd22eb72d"}]} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:42:52.391136 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-811da054-0369-4d05-b506-37ab5ccee41e req-0c426760-cee5-4505-a4d3-b31d2f3462c1 service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:52.391813 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-811da054-0369-4d05-b506-37ab5ccee41e req-0c426760-cee5-4505-a4d3-b31d2f3462c1 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:52.392951 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-811da054-0369-4d05-b506-37ab5ccee41e req-0c426760-cee5-4505-a4d3-b31d2f3462c1 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:52.421121 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.compute.server_external_events [req-811da054-0369-4d05-b506-37ab5ccee41e req-0c426760-cee5-4505-a4d3-b31d2f3462c1 service nova] Creating event network-changed:96884ef6-4436-4720-ad24-268bd22eb72d for instance 86989fa1-a3d2-4af9-9e2c-319ac2a8a23c on hv-cinder-85246 Aug 09 02:42:52.426671 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [req-811da054-0369-4d05-b506-37ab5ccee41e req-0c426760-cee5-4505-a4d3-b31d2f3462c1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051013 Aug 09 02:42:52.427396 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 172/328] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 02:42:52.516060 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-e79e45d6-fa85-4ff3-84eb-10fee556f90d tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:52.527853 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-e79e45d6-fa85-4ff3-84eb-10fee556f90d tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 200 len: 1722 microversion: 2.1 time: 0.297986 Aug 09 02:42:52.528982 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 157/329] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:52 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 1722 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:53.197494 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-52d1332c-006f-420c-817e-79634cdca44f tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:53.198417 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-52d1332c-006f-420c-817e-79634cdca44f tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: a587f99c-5ad7-4fa2-945e-06954d45d44d] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:53.205153 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-52d1332c-006f-420c-817e-79634cdca44f tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:53.205886 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-52d1332c-006f-420c-817e-79634cdca44f tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:53.206594 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-52d1332c-006f-420c-817e-79634cdca44f tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:53.207315 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-52d1332c-006f-420c-817e-79634cdca44f tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:53.207769 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-52d1332c-006f-420c-817e-79634cdca44f tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:53.208224 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-52d1332c-006f-420c-817e-79634cdca44f tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:53.347268 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-52d1332c-006f-420c-817e-79634cdca44f tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:53.355046 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-52d1332c-006f-420c-817e-79634cdca44f tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d" status: 200 len: 1521 microversion: 2.1 time: 0.162420 Aug 09 02:42:53.355627 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 173/330] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:53 2022] GET /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:53.554824 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-770145fb-bbec-42d1-b5f6-de04e9477ac4 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:53.555281 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-770145fb-bbec-42d1-b5f6-de04e9477ac4 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:53.566206 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-770145fb-bbec-42d1-b5f6-de04e9477ac4 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:53.567106 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-770145fb-bbec-42d1-b5f6-de04e9477ac4 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:53.567693 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-770145fb-bbec-42d1-b5f6-de04e9477ac4 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:53.568748 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-770145fb-bbec-42d1-b5f6-de04e9477ac4 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:53.569747 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-770145fb-bbec-42d1-b5f6-de04e9477ac4 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:53.570144 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-770145fb-bbec-42d1-b5f6-de04e9477ac4 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:53.703497 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-770145fb-bbec-42d1-b5f6-de04e9477ac4 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:53.713114 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-770145fb-bbec-42d1-b5f6-de04e9477ac4 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 200 len: 1722 microversion: 2.1 time: 0.162465 Aug 09 02:42:53.713699 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 158/331] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:53 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:54.379977 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-e18465de-f0d9-4bfe-ab4d-67a08d0c844b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:54.380645 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-e18465de-f0d9-4bfe-ab4d-67a08d0c844b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: a587f99c-5ad7-4fa2-945e-06954d45d44d] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:54.388822 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e18465de-f0d9-4bfe-ab4d-67a08d0c844b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:54.389409 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e18465de-f0d9-4bfe-ab4d-67a08d0c844b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:54.389919 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e18465de-f0d9-4bfe-ab4d-67a08d0c844b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:54.390762 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e18465de-f0d9-4bfe-ab4d-67a08d0c844b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:54.391306 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e18465de-f0d9-4bfe-ab4d-67a08d0c844b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:54.391804 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e18465de-f0d9-4bfe-ab4d-67a08d0c844b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:54.613859 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-e18465de-f0d9-4bfe-ab4d-67a08d0c844b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:54.626033 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-e18465de-f0d9-4bfe-ab4d-67a08d0c844b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d" status: 200 len: 1521 microversion: 2.1 time: 0.250768 Aug 09 02:42:54.627177 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 174/332] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:54 2022] GET /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d => generated 1521 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:54.738250 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-f920cd6e-3581-441e-b0b2-14e9e2209860 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:54.738967 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-f920cd6e-3581-441e-b0b2-14e9e2209860 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:54.745166 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f920cd6e-3581-441e-b0b2-14e9e2209860 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:54.745638 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f920cd6e-3581-441e-b0b2-14e9e2209860 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:54.746063 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f920cd6e-3581-441e-b0b2-14e9e2209860 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:54.746797 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f920cd6e-3581-441e-b0b2-14e9e2209860 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:54.747239 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f920cd6e-3581-441e-b0b2-14e9e2209860 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:54.747651 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f920cd6e-3581-441e-b0b2-14e9e2209860 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:54.890172 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-f920cd6e-3581-441e-b0b2-14e9e2209860 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:54.898582 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-f920cd6e-3581-441e-b0b2-14e9e2209860 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 200 len: 1722 microversion: 2.1 time: 0.167948 Aug 09 02:42:54.899155 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 159/333] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:54 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:55.663514 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-a11d041a-9ffa-45dc-befb-e07f4fac253b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:55.664125 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-a11d041a-9ffa-45dc-befb-e07f4fac253b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: a587f99c-5ad7-4fa2-945e-06954d45d44d] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:55.670819 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a11d041a-9ffa-45dc-befb-e07f4fac253b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:55.671303 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a11d041a-9ffa-45dc-befb-e07f4fac253b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:55.671753 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a11d041a-9ffa-45dc-befb-e07f4fac253b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:55.672431 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a11d041a-9ffa-45dc-befb-e07f4fac253b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:55.672877 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a11d041a-9ffa-45dc-befb-e07f4fac253b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:55.673280 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a11d041a-9ffa-45dc-befb-e07f4fac253b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:55.878668 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-a11d041a-9ffa-45dc-befb-e07f4fac253b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:55.886509 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-a11d041a-9ffa-45dc-befb-e07f4fac253b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d" status: 200 len: 1521 microversion: 2.1 time: 0.226846 Aug 09 02:42:55.887108 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 175/334] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:55 2022] GET /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:55.920321 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-f8e0ec09-73b3-43ac-9e84-665b4e87cb0c tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:55.920886 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-f8e0ec09-73b3-43ac-9e84-665b4e87cb0c tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:55.927571 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f8e0ec09-73b3-43ac-9e84-665b4e87cb0c tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:55.928061 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f8e0ec09-73b3-43ac-9e84-665b4e87cb0c tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:55.928508 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f8e0ec09-73b3-43ac-9e84-665b4e87cb0c tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:55.929279 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f8e0ec09-73b3-43ac-9e84-665b4e87cb0c tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:55.929768 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f8e0ec09-73b3-43ac-9e84-665b4e87cb0c tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:55.930267 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f8e0ec09-73b3-43ac-9e84-665b4e87cb0c tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:56.062749 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-f8e0ec09-73b3-43ac-9e84-665b4e87cb0c tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:56.070780 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-f8e0ec09-73b3-43ac-9e84-665b4e87cb0c tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 200 len: 1722 microversion: 2.1 time: 0.154501 Aug 09 02:42:56.071308 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 160/335] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:55 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:56.907909 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-8c13c551-4598-47a0-9c4a-36756dfde4a7 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:56.908534 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-8c13c551-4598-47a0-9c4a-36756dfde4a7 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: a587f99c-5ad7-4fa2-945e-06954d45d44d] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:56.914953 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8c13c551-4598-47a0-9c4a-36756dfde4a7 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:56.915399 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8c13c551-4598-47a0-9c4a-36756dfde4a7 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:56.915824 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8c13c551-4598-47a0-9c4a-36756dfde4a7 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:56.916486 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8c13c551-4598-47a0-9c4a-36756dfde4a7 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:56.916928 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8c13c551-4598-47a0-9c4a-36756dfde4a7 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:56.917359 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8c13c551-4598-47a0-9c4a-36756dfde4a7 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:57.053675 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-8c13c551-4598-47a0-9c4a-36756dfde4a7 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:57.061411 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-8c13c551-4598-47a0-9c4a-36756dfde4a7 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d" status: 200 len: 1501 microversion: 2.1 time: 0.157473 Aug 09 02:42:57.075923 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 176/336] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:56 2022] GET /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d => generated 1501 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:57.082099 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-59d15981-2565-40a9-903f-f4f6e6d679d8 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "23965cd3-2478-4ef9-9148-a3e643aae421"}} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:42:57.084632 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-59d15981-2565-40a9-903f-f4f6e6d679d8 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: a587f99c-5ad7-4fa2-945e-06954d45d44d] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:57.091569 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-59d15981-2565-40a9-903f-f4f6e6d679d8 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:57.091980 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-59d15981-2565-40a9-903f-f4f6e6d679d8 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:57.092424 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-59d15981-2565-40a9-903f-f4f6e6d679d8 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:57.092737 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-9eaf20c2-106f-4d66-8b73-4b26aab4b7f9 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:57.093180 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-59d15981-2565-40a9-903f-f4f6e6d679d8 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:57.093480 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-9eaf20c2-106f-4d66-8b73-4b26aab4b7f9 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:57.093609 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-59d15981-2565-40a9-903f-f4f6e6d679d8 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:57.094012 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-59d15981-2565-40a9-903f-f4f6e6d679d8 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:57.100365 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9eaf20c2-106f-4d66-8b73-4b26aab4b7f9 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:57.100905 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9eaf20c2-106f-4d66-8b73-4b26aab4b7f9 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:57.101370 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9eaf20c2-106f-4d66-8b73-4b26aab4b7f9 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:57.102057 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9eaf20c2-106f-4d66-8b73-4b26aab4b7f9 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:57.102530 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9eaf20c2-106f-4d66-8b73-4b26aab4b7f9 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:57.102955 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9eaf20c2-106f-4d66-8b73-4b26aab4b7f9 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:57.109611 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_cell1:SELECT=100 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:42:57.119822 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.wsgi [None req-59d15981-2565-40a9-903f-f4f6e6d679d8 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] HTTP exception thrown: Cannot 'attach_volume' instance a587f99c-5ad7-4fa2-945e-06954d45d44d while it is in vm_state rescued Aug 09 02:42:57.122039 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-59d15981-2565-40a9-903f-f4f6e6d679d8 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Request method failure captured: Aug 09 02:42:57.122039 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: request: POST /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d/os-volume_attachments HTTP/1.1 Aug 09 02:42:57.122039 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Accept: application/json Aug 09 02:42:57.122039 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Accept-Encoding: identity Aug 09 02:42:57.122039 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Connection: close Aug 09 02:42:57.122039 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Content-Length: 74 Aug 09 02:42:57.122039 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Content-Type: application/json Aug 09 02:42:57.122039 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Host: 10.222.0.20 Aug 09 02:42:57.122039 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Openstack-System-Scope: None Aug 09 02:42:57.122039 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: User-Agent: python-urllib3/1.26.11 Aug 09 02:42:57.122039 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Auth-Token: gAAAAABi8ck0CktcbMqTyHyXW8raM7iadadJrEMEsJe1QuxYKiBhpTouij9hVxYkaHqXy09_JT1eLz1wDM3rcA0s4PsRbPJ5NcIAOnut9F1rfjVmZ0ZLJHay53lPPXa7QLsuxiazoAiezHqBT1Xd8Rz6-J34U6-EpZWhwazb9UjXN8mMBEdn5c0 Aug 09 02:42:57.122039 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Domain-Id: None Aug 09 02:42:57.122039 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Domain-Name: None Aug 09 02:42:57.122039 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Identity-Status: Confirmed Aug 09 02:42:57.122039 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Is-Admin-Project: True Aug 09 02:42:57.122039 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Domain-Id: default Aug 09 02:42:57.122039 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Domain-Name: Default Aug 09 02:42:57.122039 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Id: 65aab6ab3ce94cbd93916edf9c3eedc0 Aug 09 02:42:57.122039 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-806361088 Aug 09 02:42:57.122039 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Role: reader,member Aug 09 02:42:57.122039 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Roles: reader,member Aug 09 02:42:57.123463 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/65aab6ab3ce94cbd93916edf9c3eedc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/65aab6ab3ce94cbd93916edf9c3eedc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_65aab6ab3ce94cbd93916edf9c3eedc0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/65aab6ab3ce94cbd93916edf9c3eedc0"}]}] Aug 09 02:42:57.123463 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant: tempest-ServerRescueNegativeTestJSON-806361088 Aug 09 02:42:57.123463 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant-Id: 65aab6ab3ce94cbd93916edf9c3eedc0 Aug 09 02:42:57.123463 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-806361088 Aug 09 02:42:57.123463 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User: tempest-ServerRescueNegativeTestJSON-806361088-project Aug 09 02:42:57.123463 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Domain-Id: default Aug 09 02:42:57.123463 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Domain-Name: Default Aug 09 02:42:57.123463 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Id: 192a8abd4c7a4535a42bea7648535dc3 Aug 09 02:42:57.123463 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Name: tempest-ServerRescueNegativeTestJSON-806361088-project Aug 09 02:42:57.123463 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Aug 09 02:42:57.123463 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: {"volumeAttachment": {"volumeId": "23965cd3-2478-4ef9-9148-a3e643aae421"}} Aug 09 02:42:57.123463 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: method: > Aug 09 02:42:57.124314 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: exception: Cannot 'attach_volume' instance a587f99c-5ad7-4fa2-945e-06954d45d44d while it is in vm_state rescued Aug 09 02:42:57.124314 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: action_args: {'server_id': 'a587f99c-5ad7-4fa2-945e-06954d45d44d', 'body': {'volumeAttachment': {'volumeId': '23965cd3-2478-4ef9-9148-a3e643aae421'}}} Aug 09 02:42:57.124314 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 02:42:57.124314 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:42:57.124314 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 09 02:42:57.124314 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 09 02:42:57.124314 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 02:42:57.124314 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 02:42:57.124314 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 09 02:42:57.124314 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 09 02:42:57.124314 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a587f99c-5ad7-4fa2-945e-06954d45d44d in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 09 02:42:57.124314 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:42:57.124314 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:42:57.124314 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:42:57.124314 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:42:57.124314 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:42:57.124314 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:42:57.124314 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 02:42:57.124314 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 02:42:57.125477 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 02:42:57.125477 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 02:42:57.125477 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 02:42:57.125477 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 02:42:57.125477 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 02:42:57.125477 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 02:42:57.125477 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 02:42:57.125477 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 02:42:57.125477 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 09 02:42:57.125477 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 09 02:42:57.125477 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 09 02:42:57.125477 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 09 02:42:57.125477 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance a587f99c-5ad7-4fa2-945e-06954d45d44d while it is in vm_state rescued Aug 09 02:42:57.125477 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:42:57.125477 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:42:57.125477 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:42:57.125477 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:42:57.125477 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:42:57.125477 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:42:57.126716 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 02:42:57.126716 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 02:42:57.126716 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance a587f99c-5ad7-4fa2-945e-06954d45d44d while it is in vm_state rescued Aug 09 02:42:57.126716 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:42:57.126716 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-59d15981-2565-40a9-903f-f4f6e6d679d8 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Returning 409 to user: Cannot 'attach_volume' instance a587f99c-5ad7-4fa2-945e-06954d45d44d while it is in vm_state rescued {{(pid=124425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 02:42:57.126716 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-59d15981-2565-40a9-903f-f4f6e6d679d8 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "POST /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.045642 Aug 09 02:42:57.126716 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 161/337] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Aug 9 02:42:57 2022] POST /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d/os-volume_attachments => generated 152 bytes in 47 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 09 02:42:57.133469 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-7ed467da-7080-487f-a15e-42a93b90099b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:42:57.139334 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-7ed467da-7080-487f-a15e-42a93b90099b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: a587f99c-5ad7-4fa2-945e-06954d45d44d] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:57.146853 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7ed467da-7080-487f-a15e-42a93b90099b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:57.147384 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7ed467da-7080-487f-a15e-42a93b90099b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:57.147847 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7ed467da-7080-487f-a15e-42a93b90099b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:57.148685 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7ed467da-7080-487f-a15e-42a93b90099b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:57.150063 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7ed467da-7080-487f-a15e-42a93b90099b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:57.150686 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7ed467da-7080-487f-a15e-42a93b90099b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:57.228234 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-7ed467da-7080-487f-a15e-42a93b90099b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "POST /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d/action" status: 202 len: 0 microversion: 2.1 time: 0.098684 Aug 09 02:42:57.232534 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 162/338] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Aug 9 02:42:57 2022] POST /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 02:42:57.239725 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-fba12932-c127-4a3d-9ad6-2611841ecd56 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:57.241373 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-fba12932-c127-4a3d-9ad6-2611841ecd56 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: a587f99c-5ad7-4fa2-945e-06954d45d44d] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:57.255678 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-9eaf20c2-106f-4d66-8b73-4b26aab4b7f9 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:57.256031 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-fba12932-c127-4a3d-9ad6-2611841ecd56 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:57.256452 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-fba12932-c127-4a3d-9ad6-2611841ecd56 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:57.256920 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-fba12932-c127-4a3d-9ad6-2611841ecd56 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:57.257717 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-fba12932-c127-4a3d-9ad6-2611841ecd56 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:57.258490 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-fba12932-c127-4a3d-9ad6-2611841ecd56 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:57.259063 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-fba12932-c127-4a3d-9ad6-2611841ecd56 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:57.268127 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-9eaf20c2-106f-4d66-8b73-4b26aab4b7f9 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 200 len: 1722 microversion: 2.1 time: 0.179409 Aug 09 02:42:57.283621 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 177/339] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:57 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:42:57.511030 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-fba12932-c127-4a3d-9ad6-2611841ecd56 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:57.518715 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-fba12932-c127-4a3d-9ad6-2611841ecd56 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d" status: 200 len: 1509 microversion: 2.1 time: 0.283986 Aug 09 02:42:57.519301 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 163/340] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:57 2022] GET /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d => generated 1509 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:58.300715 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-4bc0bcf4-7ce1-4ca6-9fbd-6966b3c47f34 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:58.301643 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-4bc0bcf4-7ce1-4ca6-9fbd-6966b3c47f34 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:58.311732 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4bc0bcf4-7ce1-4ca6-9fbd-6966b3c47f34 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:58.312235 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4bc0bcf4-7ce1-4ca6-9fbd-6966b3c47f34 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:58.312644 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4bc0bcf4-7ce1-4ca6-9fbd-6966b3c47f34 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:58.313339 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4bc0bcf4-7ce1-4ca6-9fbd-6966b3c47f34 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:58.313788 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4bc0bcf4-7ce1-4ca6-9fbd-6966b3c47f34 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:58.314288 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4bc0bcf4-7ce1-4ca6-9fbd-6966b3c47f34 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:58.448665 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-4bc0bcf4-7ce1-4ca6-9fbd-6966b3c47f34 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:58.456824 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-4bc0bcf4-7ce1-4ca6-9fbd-6966b3c47f34 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 200 len: 1722 microversion: 2.1 time: 0.162231 Aug 09 02:42:58.457804 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 178/341] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:58 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:58.540661 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-c8b442de-3c63-4193-b806-d5a1380b42d3 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:58.541264 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-c8b442de-3c63-4193-b806-d5a1380b42d3 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: a587f99c-5ad7-4fa2-945e-06954d45d44d] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:58.547841 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c8b442de-3c63-4193-b806-d5a1380b42d3 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:58.548319 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c8b442de-3c63-4193-b806-d5a1380b42d3 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:58.548792 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c8b442de-3c63-4193-b806-d5a1380b42d3 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:58.549480 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c8b442de-3c63-4193-b806-d5a1380b42d3 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:58.549929 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c8b442de-3c63-4193-b806-d5a1380b42d3 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:58.550376 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c8b442de-3c63-4193-b806-d5a1380b42d3 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:58.687808 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-c8b442de-3c63-4193-b806-d5a1380b42d3 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:58.699148 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-c8b442de-3c63-4193-b806-d5a1380b42d3 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d" status: 200 len: 1509 microversion: 2.1 time: 0.162484 Aug 09 02:42:58.700659 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 164/342] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:58 2022] GET /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d => generated 1509 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:59.481332 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-d65462f6-e4b1-4fac-bf61-5c2816677ebf tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:59.481933 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-d65462f6-e4b1-4fac-bf61-5c2816677ebf tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:59.489337 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d65462f6-e4b1-4fac-bf61-5c2816677ebf tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:59.489796 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d65462f6-e4b1-4fac-bf61-5c2816677ebf tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:59.490259 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d65462f6-e4b1-4fac-bf61-5c2816677ebf tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:59.490977 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d65462f6-e4b1-4fac-bf61-5c2816677ebf tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:59.491442 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d65462f6-e4b1-4fac-bf61-5c2816677ebf tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:59.491864 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d65462f6-e4b1-4fac-bf61-5c2816677ebf tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:59.634912 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-d65462f6-e4b1-4fac-bf61-5c2816677ebf tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:59.643587 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-d65462f6-e4b1-4fac-bf61-5c2816677ebf tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 200 len: 1722 microversion: 2.1 time: 0.168670 Aug 09 02:42:59.645042 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 179/343] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:59 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:42:59.721806 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-62249db4-7eb7-49a3-b9c6-9ee4e49c0d37 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:42:59.722603 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-62249db4-7eb7-49a3-b9c6-9ee4e49c0d37 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: a587f99c-5ad7-4fa2-945e-06954d45d44d] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:42:59.729472 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-62249db4-7eb7-49a3-b9c6-9ee4e49c0d37 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:59.730043 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-62249db4-7eb7-49a3-b9c6-9ee4e49c0d37 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:59.730535 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-62249db4-7eb7-49a3-b9c6-9ee4e49c0d37 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:59.731540 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-62249db4-7eb7-49a3-b9c6-9ee4e49c0d37 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:42:59.731993 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-62249db4-7eb7-49a3-b9c6-9ee4e49c0d37 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:42:59.732414 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-62249db4-7eb7-49a3-b9c6-9ee4e49c0d37 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:42:59.876116 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-62249db4-7eb7-49a3-b9c6-9ee4e49c0d37 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:42:59.883723 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-62249db4-7eb7-49a3-b9c6-9ee4e49c0d37 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d" status: 200 len: 1509 microversion: 2.1 time: 0.165969 Aug 09 02:42:59.884286 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 165/344] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:42:59 2022] GET /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d => generated 1509 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:43:00.666320 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-757938c1-cec0-4fcd-ba6f-c83cfb2f0f5f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:00.666932 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-757938c1-cec0-4fcd-ba6f-c83cfb2f0f5f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:00.673982 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-757938c1-cec0-4fcd-ba6f-c83cfb2f0f5f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:00.674495 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-757938c1-cec0-4fcd-ba6f-c83cfb2f0f5f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:00.674925 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-757938c1-cec0-4fcd-ba6f-c83cfb2f0f5f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:00.675614 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-757938c1-cec0-4fcd-ba6f-c83cfb2f0f5f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:00.676063 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-757938c1-cec0-4fcd-ba6f-c83cfb2f0f5f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:00.676508 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-757938c1-cec0-4fcd-ba6f-c83cfb2f0f5f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:00.824044 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-757938c1-cec0-4fcd-ba6f-c83cfb2f0f5f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:00.832258 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-757938c1-cec0-4fcd-ba6f-c83cfb2f0f5f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 200 len: 1722 microversion: 2.1 time: 0.169938 Aug 09 02:43:00.833134 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 180/345] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:00 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:43:00.904644 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-b3ae00ad-7ab9-4aa1-942b-9661990a90f4 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:00.905199 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-b3ae00ad-7ab9-4aa1-942b-9661990a90f4 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: a587f99c-5ad7-4fa2-945e-06954d45d44d] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:00.907627 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:43:00.913477 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b3ae00ad-7ab9-4aa1-942b-9661990a90f4 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:00.914054 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b3ae00ad-7ab9-4aa1-942b-9661990a90f4 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:00.914573 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b3ae00ad-7ab9-4aa1-942b-9661990a90f4 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:00.915244 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b3ae00ad-7ab9-4aa1-942b-9661990a90f4 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:00.915689 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b3ae00ad-7ab9-4aa1-942b-9661990a90f4 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:00.916106 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b3ae00ad-7ab9-4aa1-942b-9661990a90f4 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:01.050623 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-b3ae00ad-7ab9-4aa1-942b-9661990a90f4 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:01.058279 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-b3ae00ad-7ab9-4aa1-942b-9661990a90f4 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d" status: 200 len: 1515 microversion: 2.1 time: 0.157584 Aug 09 02:43:01.058842 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 166/346] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:00 2022] GET /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:43:01.861193 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-bc891a7a-1064-4dc3-b61d-b8e7754e05b8 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:01.861835 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-bc891a7a-1064-4dc3-b61d-b8e7754e05b8 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:01.868691 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-bc891a7a-1064-4dc3-b61d-b8e7754e05b8 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:01.869179 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-bc891a7a-1064-4dc3-b61d-b8e7754e05b8 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:01.869615 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-bc891a7a-1064-4dc3-b61d-b8e7754e05b8 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:01.870354 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-bc891a7a-1064-4dc3-b61d-b8e7754e05b8 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:01.870810 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-bc891a7a-1064-4dc3-b61d-b8e7754e05b8 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:01.871305 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-bc891a7a-1064-4dc3-b61d-b8e7754e05b8 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:02.007171 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-bc891a7a-1064-4dc3-b61d-b8e7754e05b8 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:02.015787 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-bc891a7a-1064-4dc3-b61d-b8e7754e05b8 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 200 len: 1699 microversion: 2.1 time: 0.158635 Aug 09 02:43:02.016356 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 181/347] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:01 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 1699 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:43:02.036591 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-5950106a-04d8-47c4-9625-4d0052e5552f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:43:02.055962 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-5950106a-04d8-47c4-9625-4d0052e5552f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:02.056865 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-5950106a-04d8-47c4-9625-4d0052e5552f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:02.056865 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-5950106a-04d8-47c4-9625-4d0052e5552f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:02.116467 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-5950106a-04d8-47c4-9625-4d0052e5552f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Going to try to start instance {{(pid=124425) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 09 02:43:02.159625 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-5950106a-04d8-47c4-9625-4d0052e5552f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "POST /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89/action" status: 202 len: 0 microversion: 2.1 time: 0.126714 Aug 09 02:43:02.161774 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 167/348] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Aug 9 02:43:02 2022] POST /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 02:43:02.172285 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-fe072e18-7545-434b-b362-f18cdc2a9140 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:02.173480 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-fe072e18-7545-434b-b362-f18cdc2a9140 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:02.179710 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-fe072e18-7545-434b-b362-f18cdc2a9140 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:02.180185 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-fe072e18-7545-434b-b362-f18cdc2a9140 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:02.180609 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-fe072e18-7545-434b-b362-f18cdc2a9140 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:02.181342 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-fe072e18-7545-434b-b362-f18cdc2a9140 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:02.181959 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-fe072e18-7545-434b-b362-f18cdc2a9140 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:02.182483 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-fe072e18-7545-434b-b362-f18cdc2a9140 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:02.335564 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-fe072e18-7545-434b-b362-f18cdc2a9140 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:02.346281 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-fe072e18-7545-434b-b362-f18cdc2a9140 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 200 len: 1708 microversion: 2.1 time: 0.179793 Aug 09 02:43:02.346941 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 182/349] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:02 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 1708 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:43:02.443418 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-0da6b82e-17d0-46e9-a175-ae632a91105c tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Action: 'create', calling method: .version_select at 0x7fb0a0dfeb80>, body: {"keypair": {"name": "tempest-keypair-142490633", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ14hgXur9NBNK/lgFoaNyn6hM95X5SmtqNUd66jwUOvFSeJl5GrOxk+ui6Ma1vjXqyy5ve47g1UYCq23LXgUuBqxOYlA8yS194Wv/CArKPniwRGadx1gYPGcToP0aWS6w=="}} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:43:02.467083 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.quota [None req-0da6b82e-17d0-46e9-a175-ae632a91105c tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Getting quotas for project 65aab6ab3ce94cbd93916edf9c3eedc0. Resources: {'key_pairs'} {{(pid=124425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 02:43:02.471103 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.quota [None req-0da6b82e-17d0-46e9-a175-ae632a91105c tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Getting quotas for user 192a8abd4c7a4535a42bea7648535dc3 and project 65aab6ab3ce94cbd93916edf9c3eedc0. Resources: {'key_pairs'} {{(pid=124425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 02:43:02.500306 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-0da6b82e-17d0-46e9-a175-ae632a91105c tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.062032 Aug 09 02:43:02.501407 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 168/350] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Aug 9 02:43:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:43:03.334038 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-7bb2c6db-94f7-4739-b1c3-5aaeb428625f tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1172344140", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-93674777", "security_groups": [{"name": "tempest-secgroup-smoke-1734634472"}], "block_device_mapping_v2": [{"uuid": "95a59f6e-74c4-481f-975c-c9cbff04562e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b1e2d894-011a-4b96-b401-d6a3370e9f10"}]}} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:43:03.368071 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-9cd82daf-f8d0-4b2d-a84d-c5a74d9eb36f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:03.369442 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-9cd82daf-f8d0-4b2d-a84d-c5a74d9eb36f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:03.376969 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9cd82daf-f8d0-4b2d-a84d-c5a74d9eb36f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:03.377732 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9cd82daf-f8d0-4b2d-a84d-c5a74d9eb36f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:03.378434 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9cd82daf-f8d0-4b2d-a84d-c5a74d9eb36f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:03.379381 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9cd82daf-f8d0-4b2d-a84d-c5a74d9eb36f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:03.379891 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9cd82daf-f8d0-4b2d-a84d-c5a74d9eb36f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:03.380846 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9cd82daf-f8d0-4b2d-a84d-c5a74d9eb36f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:03.587013 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.network.neutron [None req-7bb2c6db-94f7-4739-b1c3-5aaeb428625f tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] validate_networks() for [('b1e2d894-011a-4b96-b401-d6a3370e9f10', None, None, None, None, None)] {{(pid=124427) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 02:43:03.692718 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-9cd82daf-f8d0-4b2d-a84d-c5a74d9eb36f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:03.702362 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-9cd82daf-f8d0-4b2d-a84d-c5a74d9eb36f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 200 len: 1708 microversion: 2.1 time: 0.337514 Aug 09 02:43:03.703494 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 169/351] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:03 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 1708 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:43:04.459435 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.virt.hardware [None req-7bb2c6db-94f7-4739-b1c3-5aaeb428625f tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Flavor limits 0:0:0 {{(pid=124427) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 02:43:04.459966 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.virt.hardware [None req-7bb2c6db-94f7-4739-b1c3-5aaeb428625f tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Image limits 0:0:0 {{(pid=124427) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 02:43:04.460778 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.virt.hardware [None req-7bb2c6db-94f7-4739-b1c3-5aaeb428625f tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Flavor pref 0:0:0 {{(pid=124427) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 02:43:04.461270 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.virt.hardware [None req-7bb2c6db-94f7-4739-b1c3-5aaeb428625f tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Image pref 0:0:0 {{(pid=124427) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 02:43:04.461960 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.virt.hardware [None req-7bb2c6db-94f7-4739-b1c3-5aaeb428625f tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124427) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 02:43:04.473029 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7bb2c6db-94f7-4739-b1c3-5aaeb428625f tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:04.473900 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7bb2c6db-94f7-4739-b1c3-5aaeb428625f tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:04.474603 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7bb2c6db-94f7-4739-b1c3-5aaeb428625f tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:04.475752 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7bb2c6db-94f7-4739-b1c3-5aaeb428625f tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:04.476410 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7bb2c6db-94f7-4739-b1c3-5aaeb428625f tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:04.477080 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7bb2c6db-94f7-4739-b1c3-5aaeb428625f tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:04.502725 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.quota [None req-7bb2c6db-94f7-4739-b1c3-5aaeb428625f tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Getting quotas for project 9aadaf242f674436a45eae700fb52fc1. Resources: {'cores', 'ram', 'instances'} {{(pid=124427) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 02:43:04.508295 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.quota [None req-7bb2c6db-94f7-4739-b1c3-5aaeb428625f tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Getting quotas for user 90fa94f90d49485a81d502929bcd0b93 and project 9aadaf242f674436a45eae700fb52fc1. Resources: {'cores', 'ram', 'instances'} {{(pid=124427) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 02:43:04.576014 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-7bb2c6db-94f7-4739-b1c3-5aaeb428625f tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Going to run 1 instances... {{(pid=124427) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 02:43:04.578426 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-7bb2c6db-94f7-4739-b1c3-5aaeb428625f tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 61f94aa1-75dc-4f43-aa71-284c50dc394c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='95a59f6e-74c4-481f-975c-c9cbff04562e',volume_size=None,volume_type=None)] {{(pid=124427) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 02:43:04.724821 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-bc71d0d0-7b7a-45f1-8135-18c0fe149f65 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:04.725552 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-bc71d0d0-7b7a-45f1-8135-18c0fe149f65 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:04.735869 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-bc71d0d0-7b7a-45f1-8135-18c0fe149f65 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:04.739033 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-bc71d0d0-7b7a-45f1-8135-18c0fe149f65 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:04.740768 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-bc71d0d0-7b7a-45f1-8135-18c0fe149f65 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:04.741609 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-bc71d0d0-7b7a-45f1-8135-18c0fe149f65 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:04.742718 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-bc71d0d0-7b7a-45f1-8135-18c0fe149f65 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:04.746630 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-bc71d0d0-7b7a-45f1-8135-18c0fe149f65 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:04.799202 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-7bb2c6db-94f7-4739-b1c3-5aaeb428625f tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.468139 Aug 09 02:43:04.800962 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 183/352] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Aug 9 02:43:03 2022] POST /compute/v2.1/servers => generated 406 bytes in 1471 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 02:43:04.812209 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-b22cffe0-aaa0-4865-8789-a3cc42b95650 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:04.813021 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-b22cffe0-aaa0-4865-8789-a3cc42b95650 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 61f94aa1-75dc-4f43-aa71-284c50dc394c] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:04.883022 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-b22cffe0-aaa0-4865-8789-a3cc42b95650 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:04.891565 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-b22cffe0-aaa0-4865-8789-a3cc42b95650 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/61f94aa1-75dc-4f43-aa71-284c50dc394c" status: 200 len: 1093 microversion: 2.1 time: 0.083854 Aug 09 02:43:04.892216 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 184/353] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:04 2022] GET /compute/v2.1/servers/61f94aa1-75dc-4f43-aa71-284c50dc394c => generated 1093 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:43:04.908446 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-490bfa52-a766-47f6-998f-f51b5716514e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-254054484", "imageRef": "04a06944-b2a8-4a65-b2a6-7ed3ff18a627", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "383daeb1-4f03-438c-8857-8e6c80656675"}], "security_groups": [{"name": "tempest-securitygroup--1694996066"}], "key_name": "tempest-keypair-142490633", "user_data": "}} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:43:04.997013 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-bc71d0d0-7b7a-45f1-8135-18c0fe149f65 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:05.008011 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-bc71d0d0-7b7a-45f1-8135-18c0fe149f65 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 200 len: 1712 microversion: 2.1 time: 0.287838 Aug 09 02:43:05.011427 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 170/354] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:04 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 1712 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:43:05.084300 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.network.neutron [None req-490bfa52-a766-47f6-998f-f51b5716514e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] validate_networks() for [('383daeb1-4f03-438c-8857-8e6c80656675', None, None, None, None, None)] {{(pid=124427) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 02:43:05.625309 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.virt.hardware [None req-490bfa52-a766-47f6-998f-f51b5716514e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Flavor limits 0:0:0 {{(pid=124427) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 02:43:05.625891 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.virt.hardware [None req-490bfa52-a766-47f6-998f-f51b5716514e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Image limits 0:0:0 {{(pid=124427) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 02:43:05.626464 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.virt.hardware [None req-490bfa52-a766-47f6-998f-f51b5716514e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Flavor pref 0:0:0 {{(pid=124427) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 02:43:05.627113 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.virt.hardware [None req-490bfa52-a766-47f6-998f-f51b5716514e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Image pref 0:0:0 {{(pid=124427) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 02:43:05.627622 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.virt.hardware [None req-490bfa52-a766-47f6-998f-f51b5716514e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124427) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 02:43:05.637085 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-490bfa52-a766-47f6-998f-f51b5716514e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:05.637693 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-490bfa52-a766-47f6-998f-f51b5716514e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:05.638241 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-490bfa52-a766-47f6-998f-f51b5716514e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:05.639166 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-490bfa52-a766-47f6-998f-f51b5716514e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:05.639712 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-490bfa52-a766-47f6-998f-f51b5716514e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:05.640188 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-490bfa52-a766-47f6-998f-f51b5716514e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:05.657648 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.quota [None req-490bfa52-a766-47f6-998f-f51b5716514e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Getting quotas for project 65aab6ab3ce94cbd93916edf9c3eedc0. Resources: {'cores', 'ram', 'instances'} {{(pid=124427) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 02:43:05.661607 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.quota [None req-490bfa52-a766-47f6-998f-f51b5716514e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Getting quotas for user 192a8abd4c7a4535a42bea7648535dc3 and project 65aab6ab3ce94cbd93916edf9c3eedc0. Resources: {'cores', 'ram', 'instances'} {{(pid=124427) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 02:43:05.672706 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-490bfa52-a766-47f6-998f-f51b5716514e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Going to run 1 instances... {{(pid=124427) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 02:43:05.675257 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-490bfa52-a766-47f6-998f-f51b5716514e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: b9369cf3-95d7-41d2-8157-ca2c165b062d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='04a06944-b2a8-4a65-b2a6-7ed3ff18a627',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124427) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 02:43:05.733685 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-490bfa52-a766-47f6-998f-f51b5716514e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.840065 Aug 09 02:43:05.738308 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 185/355] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Aug 9 02:43:04 2022] POST /compute/v2.1/servers => generated 409 bytes in 846 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 02:43:05.747476 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-40e45f83-0962-45a7-a3f4-2c3a64d73b46 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:05.748730 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-40e45f83-0962-45a7-a3f4-2c3a64d73b46 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: b9369cf3-95d7-41d2-8157-ca2c165b062d] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:05.809424 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-40e45f83-0962-45a7-a3f4-2c3a64d73b46 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:05.817325 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-40e45f83-0962-45a7-a3f4-2c3a64d73b46 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d" status: 200 len: 1244 microversion: 2.1 time: 0.075381 Aug 09 02:43:05.819563 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 171/356] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:05 2022] GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d => generated 1244 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:43:05.913909 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-413792b3-4072-4258-8968-28e4208c7307 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:05.914812 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-413792b3-4072-4258-8968-28e4208c7307 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 61f94aa1-75dc-4f43-aa71-284c50dc394c] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:05.922969 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-413792b3-4072-4258-8968-28e4208c7307 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:05.923920 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-413792b3-4072-4258-8968-28e4208c7307 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:05.924354 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-413792b3-4072-4258-8968-28e4208c7307 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:05.925249 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-413792b3-4072-4258-8968-28e4208c7307 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:05.925694 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-413792b3-4072-4258-8968-28e4208c7307 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:05.926318 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-413792b3-4072-4258-8968-28e4208c7307 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:05.931178 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_cell1:SELECT=100 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:43:05.996648 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-413792b3-4072-4258-8968-28e4208c7307 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:06.007040 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-413792b3-4072-4258-8968-28e4208c7307 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/61f94aa1-75dc-4f43-aa71-284c50dc394c" status: 200 len: 1191 microversion: 2.1 time: 0.099280 Aug 09 02:43:06.007839 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 186/357] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:05 2022] GET /compute/v2.1/servers/61f94aa1-75dc-4f43-aa71-284c50dc394c => generated 1191 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:43:06.839339 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-216a17c5-033f-4868-8323-f1d0d18fa1dc tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:06.840104 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-216a17c5-033f-4868-8323-f1d0d18fa1dc tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: b9369cf3-95d7-41d2-8157-ca2c165b062d] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:06.852905 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-216a17c5-033f-4868-8323-f1d0d18fa1dc tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:06.854912 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-216a17c5-033f-4868-8323-f1d0d18fa1dc tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:06.856703 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-216a17c5-033f-4868-8323-f1d0d18fa1dc tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:06.857716 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-216a17c5-033f-4868-8323-f1d0d18fa1dc tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:06.858338 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-216a17c5-033f-4868-8323-f1d0d18fa1dc tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:06.858934 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-216a17c5-033f-4868-8323-f1d0d18fa1dc tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:06.966472 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-216a17c5-033f-4868-8323-f1d0d18fa1dc tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:06.976511 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-216a17c5-033f-4868-8323-f1d0d18fa1dc tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d" status: 200 len: 1296 microversion: 2.1 time: 0.140892 Aug 09 02:43:06.977112 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 172/358] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:06 2022] GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d => generated 1296 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:43:07.028979 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-aee21ef6-f04f-40dd-b797-f7fb21284b5c tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:07.029629 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-aee21ef6-f04f-40dd-b797-f7fb21284b5c tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 61f94aa1-75dc-4f43-aa71-284c50dc394c] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:07.039962 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-aee21ef6-f04f-40dd-b797-f7fb21284b5c tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:07.043327 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-aee21ef6-f04f-40dd-b797-f7fb21284b5c tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:07.043779 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-aee21ef6-f04f-40dd-b797-f7fb21284b5c tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:07.044507 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-aee21ef6-f04f-40dd-b797-f7fb21284b5c tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:07.045979 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-aee21ef6-f04f-40dd-b797-f7fb21284b5c tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:07.046461 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-aee21ef6-f04f-40dd-b797-f7fb21284b5c tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:07.238026 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-aee21ef6-f04f-40dd-b797-f7fb21284b5c tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:07.248922 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-aee21ef6-f04f-40dd-b797-f7fb21284b5c tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/61f94aa1-75dc-4f43-aa71-284c50dc394c" status: 200 len: 1209 microversion: 2.1 time: 0.224129 Aug 09 02:43:07.250735 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 187/359] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:07 2022] GET /compute/v2.1/servers/61f94aa1-75dc-4f43-aa71-284c50dc394c => generated 1209 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:43:07.999317 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-1b003b42-ec75-4a03-8a39-b06c39c2e36e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:07.999945 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-1b003b42-ec75-4a03-8a39-b06c39c2e36e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: b9369cf3-95d7-41d2-8157-ca2c165b062d] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:08.007562 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1b003b42-ec75-4a03-8a39-b06c39c2e36e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:08.008312 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1b003b42-ec75-4a03-8a39-b06c39c2e36e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:08.008927 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1b003b42-ec75-4a03-8a39-b06c39c2e36e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:08.009902 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1b003b42-ec75-4a03-8a39-b06c39c2e36e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:08.010699 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1b003b42-ec75-4a03-8a39-b06c39c2e36e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:08.011309 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1b003b42-ec75-4a03-8a39-b06c39c2e36e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:08.122602 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-1b003b42-ec75-4a03-8a39-b06c39c2e36e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:08.132609 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-1b003b42-ec75-4a03-8a39-b06c39c2e36e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d" status: 200 len: 1302 microversion: 2.1 time: 0.137238 Aug 09 02:43:08.147112 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 173/360] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:07 2022] GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d => generated 1302 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:43:08.275457 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-97f95c9b-ad4c-44e5-ae9c-d9bf04e5597c tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:08.276061 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-97f95c9b-ad4c-44e5-ae9c-d9bf04e5597c tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 61f94aa1-75dc-4f43-aa71-284c50dc394c] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:08.289711 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-97f95c9b-ad4c-44e5-ae9c-d9bf04e5597c tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:08.290222 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-97f95c9b-ad4c-44e5-ae9c-d9bf04e5597c tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:08.290652 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-97f95c9b-ad4c-44e5-ae9c-d9bf04e5597c tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:08.291365 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-97f95c9b-ad4c-44e5-ae9c-d9bf04e5597c tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:08.291806 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-97f95c9b-ad4c-44e5-ae9c-d9bf04e5597c tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:08.292222 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-97f95c9b-ad4c-44e5-ae9c-d9bf04e5597c tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:08.743897 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-97f95c9b-ad4c-44e5-ae9c-d9bf04e5597c tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:08.757701 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-97f95c9b-ad4c-44e5-ae9c-d9bf04e5597c tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/61f94aa1-75dc-4f43-aa71-284c50dc394c" status: 200 len: 1265 microversion: 2.1 time: 0.486137 Aug 09 02:43:08.758317 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 188/361] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:08 2022] GET /compute/v2.1/servers/61f94aa1-75dc-4f43-aa71-284c50dc394c => generated 1265 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:43:09.157201 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-44ddf4a2-ca7f-414f-a0d5-f42d0ab05d29 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:09.158471 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-44ddf4a2-ca7f-414f-a0d5-f42d0ab05d29 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: b9369cf3-95d7-41d2-8157-ca2c165b062d] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:09.167872 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-44ddf4a2-ca7f-414f-a0d5-f42d0ab05d29 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:09.168416 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-44ddf4a2-ca7f-414f-a0d5-f42d0ab05d29 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:09.169076 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-44ddf4a2-ca7f-414f-a0d5-f42d0ab05d29 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:09.169976 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-44ddf4a2-ca7f-414f-a0d5-f42d0ab05d29 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:09.170682 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-44ddf4a2-ca7f-414f-a0d5-f42d0ab05d29 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:09.171302 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-44ddf4a2-ca7f-414f-a0d5-f42d0ab05d29 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:09.444139 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [req-f0e9f6fa-1733-4966-a82d-c8cadae06684 req-dddab83e-3e80-4ae1-96e5-af261c64c353 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61f94aa1-75dc-4f43-aa71-284c50dc394c", "tag": "02b344f5-9ec1-4ff5-8e96-c217038c81a6"}]} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:43:09.469475 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-f0e9f6fa-1733-4966-a82d-c8cadae06684 req-dddab83e-3e80-4ae1-96e5-af261c64c353 service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:09.472335 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-f0e9f6fa-1733-4966-a82d-c8cadae06684 req-dddab83e-3e80-4ae1-96e5-af261c64c353 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:09.472948 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-f0e9f6fa-1733-4966-a82d-c8cadae06684 req-dddab83e-3e80-4ae1-96e5-af261c64c353 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:09.486514 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.compute.server_external_events [req-f0e9f6fa-1733-4966-a82d-c8cadae06684 req-dddab83e-3e80-4ae1-96e5-af261c64c353 service nova] Creating event network-changed:02b344f5-9ec1-4ff5-8e96-c217038c81a6 for instance 61f94aa1-75dc-4f43-aa71-284c50dc394c on hv-cinder-85246 Aug 09 02:43:09.493888 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [req-f0e9f6fa-1733-4966-a82d-c8cadae06684 req-dddab83e-3e80-4ae1-96e5-af261c64c353 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059697 Aug 09 02:43:09.495047 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 189/362] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:43:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:43:09.541760 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-44ddf4a2-ca7f-414f-a0d5-f42d0ab05d29 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:09.551450 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-44ddf4a2-ca7f-414f-a0d5-f42d0ab05d29 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d" status: 200 len: 1370 microversion: 2.1 time: 0.399554 Aug 09 02:43:09.552387 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 174/363] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:09 2022] GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d => generated 1370 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:43:09.779673 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-ba7ed30a-bcf0-4634-9e68-eebdf3cbde8a tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:09.780395 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-ba7ed30a-bcf0-4634-9e68-eebdf3cbde8a tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 61f94aa1-75dc-4f43-aa71-284c50dc394c] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:09.787197 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ba7ed30a-bcf0-4634-9e68-eebdf3cbde8a tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:09.787975 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ba7ed30a-bcf0-4634-9e68-eebdf3cbde8a tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:09.788600 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ba7ed30a-bcf0-4634-9e68-eebdf3cbde8a tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:09.789724 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ba7ed30a-bcf0-4634-9e68-eebdf3cbde8a tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:09.790254 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ba7ed30a-bcf0-4634-9e68-eebdf3cbde8a tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:09.790772 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ba7ed30a-bcf0-4634-9e68-eebdf3cbde8a tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:10.181105 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-ba7ed30a-bcf0-4634-9e68-eebdf3cbde8a tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:10.195611 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-ba7ed30a-bcf0-4634-9e68-eebdf3cbde8a tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/61f94aa1-75dc-4f43-aa71-284c50dc394c" status: 200 len: 1265 microversion: 2.1 time: 0.419862 Aug 09 02:43:10.197214 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 190/364] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:09 2022] GET /compute/v2.1/servers/61f94aa1-75dc-4f43-aa71-284c50dc394c => generated 1265 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:43:10.573113 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-7cb77c91-7a63-4b0c-b1cc-5d24b23c6fba tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:10.573867 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-7cb77c91-7a63-4b0c-b1cc-5d24b23c6fba tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: b9369cf3-95d7-41d2-8157-ca2c165b062d] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:10.584898 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7cb77c91-7a63-4b0c-b1cc-5d24b23c6fba tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:10.585476 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7cb77c91-7a63-4b0c-b1cc-5d24b23c6fba tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:10.586477 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7cb77c91-7a63-4b0c-b1cc-5d24b23c6fba tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:10.589783 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7cb77c91-7a63-4b0c-b1cc-5d24b23c6fba tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:10.590383 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7cb77c91-7a63-4b0c-b1cc-5d24b23c6fba tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:10.590890 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7cb77c91-7a63-4b0c-b1cc-5d24b23c6fba tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:10.870815 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-7cb77c91-7a63-4b0c-b1cc-5d24b23c6fba tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:10.881463 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-7cb77c91-7a63-4b0c-b1cc-5d24b23c6fba tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d" status: 200 len: 1370 microversion: 2.1 time: 0.312561 Aug 09 02:43:10.883897 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 175/365] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:10 2022] GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d => generated 1370 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:43:11.228213 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-adc287fe-3f12-4bb1-96b9-4cbcdc7a45d7 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:11.228830 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-adc287fe-3f12-4bb1-96b9-4cbcdc7a45d7 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 61f94aa1-75dc-4f43-aa71-284c50dc394c] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:11.246265 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-adc287fe-3f12-4bb1-96b9-4cbcdc7a45d7 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:11.246808 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-adc287fe-3f12-4bb1-96b9-4cbcdc7a45d7 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:11.247425 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-adc287fe-3f12-4bb1-96b9-4cbcdc7a45d7 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:11.248146 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-adc287fe-3f12-4bb1-96b9-4cbcdc7a45d7 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:11.248606 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-adc287fe-3f12-4bb1-96b9-4cbcdc7a45d7 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:11.249028 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-adc287fe-3f12-4bb1-96b9-4cbcdc7a45d7 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:11.527373 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [req-d1815308-9f64-4386-9242-53695f28b1e5 req-5171eda2-d74a-4fb3-b28b-64728ed72f57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9369cf3-95d7-41d2-8157-ca2c165b062d", "tag": "5340ab1c-d934-4cfa-bf83-c7ba28e47a66"}]} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:43:11.546795 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-d1815308-9f64-4386-9242-53695f28b1e5 req-5171eda2-d74a-4fb3-b28b-64728ed72f57 service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:11.547537 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-d1815308-9f64-4386-9242-53695f28b1e5 req-5171eda2-d74a-4fb3-b28b-64728ed72f57 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:11.548240 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-d1815308-9f64-4386-9242-53695f28b1e5 req-5171eda2-d74a-4fb3-b28b-64728ed72f57 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:11.562284 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.compute.server_external_events [req-d1815308-9f64-4386-9242-53695f28b1e5 req-5171eda2-d74a-4fb3-b28b-64728ed72f57 service nova] Creating event network-changed:5340ab1c-d934-4cfa-bf83-c7ba28e47a66 for instance b9369cf3-95d7-41d2-8157-ca2c165b062d on hv-cinder-85246 Aug 09 02:43:11.570722 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [req-d1815308-9f64-4386-9242-53695f28b1e5 req-5171eda2-d74a-4fb3-b28b-64728ed72f57 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051447 Aug 09 02:43:11.571864 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 176/366] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:43:11.603798 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-adc287fe-3f12-4bb1-96b9-4cbcdc7a45d7 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:11.612731 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-adc287fe-3f12-4bb1-96b9-4cbcdc7a45d7 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/61f94aa1-75dc-4f43-aa71-284c50dc394c" status: 200 len: 1265 microversion: 2.1 time: 0.399411 Aug 09 02:43:11.630674 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 191/367] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:11 2022] GET /compute/v2.1/servers/61f94aa1-75dc-4f43-aa71-284c50dc394c => generated 1265 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:43:11.909925 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-15ed2173-fb99-4d35-9360-e18d5371acb4 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:11.911863 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-15ed2173-fb99-4d35-9360-e18d5371acb4 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: b9369cf3-95d7-41d2-8157-ca2c165b062d] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:11.923611 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-15ed2173-fb99-4d35-9360-e18d5371acb4 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:11.924311 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-15ed2173-fb99-4d35-9360-e18d5371acb4 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:11.924931 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-15ed2173-fb99-4d35-9360-e18d5371acb4 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:11.926408 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-15ed2173-fb99-4d35-9360-e18d5371acb4 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:11.927141 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-15ed2173-fb99-4d35-9360-e18d5371acb4 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:11.928335 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-15ed2173-fb99-4d35-9360-e18d5371acb4 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:12.637480 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-0c54aef5-6fc6-4ec5-bca7-3c585f8a7765 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:12.639191 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-0c54aef5-6fc6-4ec5-bca7-3c585f8a7765 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 61f94aa1-75dc-4f43-aa71-284c50dc394c] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:12.647892 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0c54aef5-6fc6-4ec5-bca7-3c585f8a7765 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:12.649084 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0c54aef5-6fc6-4ec5-bca7-3c585f8a7765 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:12.649670 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0c54aef5-6fc6-4ec5-bca7-3c585f8a7765 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:12.650585 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0c54aef5-6fc6-4ec5-bca7-3c585f8a7765 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:12.651185 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0c54aef5-6fc6-4ec5-bca7-3c585f8a7765 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:12.651893 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0c54aef5-6fc6-4ec5-bca7-3c585f8a7765 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:12.764358 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-15ed2173-fb99-4d35-9360-e18d5371acb4 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:12.782242 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-15ed2173-fb99-4d35-9360-e18d5371acb4 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d" status: 200 len: 1370 microversion: 2.1 time: 0.881218 Aug 09 02:43:12.783521 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 177/368] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:11 2022] GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d => generated 1370 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:43:12.899666 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-0c54aef5-6fc6-4ec5-bca7-3c585f8a7765 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:12.913667 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-0c54aef5-6fc6-4ec5-bca7-3c585f8a7765 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/61f94aa1-75dc-4f43-aa71-284c50dc394c" status: 200 len: 1265 microversion: 2.1 time: 0.280433 Aug 09 02:43:12.927437 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 192/369] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:12 2022] GET /compute/v2.1/servers/61f94aa1-75dc-4f43-aa71-284c50dc394c => generated 1265 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:43:13.802671 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-e3810a62-c28f-468c-a9d5-c63eecf99a06 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:13.803927 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-e3810a62-c28f-468c-a9d5-c63eecf99a06 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: b9369cf3-95d7-41d2-8157-ca2c165b062d] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:13.810912 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e3810a62-c28f-468c-a9d5-c63eecf99a06 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:13.811397 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e3810a62-c28f-468c-a9d5-c63eecf99a06 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:13.811825 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e3810a62-c28f-468c-a9d5-c63eecf99a06 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:13.812518 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e3810a62-c28f-468c-a9d5-c63eecf99a06 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:13.812950 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e3810a62-c28f-468c-a9d5-c63eecf99a06 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:13.813655 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e3810a62-c28f-468c-a9d5-c63eecf99a06 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:13.937737 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-09a0c1f4-d437-47bd-98cb-54b0e68e324f tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:13.939382 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-09a0c1f4-d437-47bd-98cb-54b0e68e324f tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 61f94aa1-75dc-4f43-aa71-284c50dc394c] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:13.949783 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-09a0c1f4-d437-47bd-98cb-54b0e68e324f tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:13.950627 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-09a0c1f4-d437-47bd-98cb-54b0e68e324f tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:13.951227 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-09a0c1f4-d437-47bd-98cb-54b0e68e324f tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:13.952349 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-09a0c1f4-d437-47bd-98cb-54b0e68e324f tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:13.952959 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-09a0c1f4-d437-47bd-98cb-54b0e68e324f tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:13.953827 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-09a0c1f4-d437-47bd-98cb-54b0e68e324f tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:14.271337 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-e3810a62-c28f-468c-a9d5-c63eecf99a06 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:14.301003 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-e3810a62-c28f-468c-a9d5-c63eecf99a06 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d" status: 200 len: 1370 microversion: 2.1 time: 0.502205 Aug 09 02:43:14.301597 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 178/370] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:13 2022] GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d => generated 1370 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:43:14.374572 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-09a0c1f4-d437-47bd-98cb-54b0e68e324f tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:14.384244 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-09a0c1f4-d437-47bd-98cb-54b0e68e324f tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/61f94aa1-75dc-4f43-aa71-284c50dc394c" status: 200 len: 1265 microversion: 2.1 time: 0.451359 Aug 09 02:43:14.386148 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 193/371] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:13 2022] GET /compute/v2.1/servers/61f94aa1-75dc-4f43-aa71-284c50dc394c => generated 1265 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:43:15.180037 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-7affdb01-e29b-4983-ae2e-5cc3b55a8c3f tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Action: 'create', calling method: .version_select at 0x7fb0a05d6940>, body: {"keypair": {"name": "tempest-TestShelveInstance-2001242133", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBg6nOJAsB2fNjG5mBReu5NUirHJCsdyfDBzPGRlHeegstBYhNpmmobZJ3IRW15fnRb9rOJx9zP3Gudscy7U8PPjzBilnsYtLH699cLy/S+LlhaR49L+h4v6WoM7Endx2g=="}} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:43:15.196293 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.quota [None req-7affdb01-e29b-4983-ae2e-5cc3b55a8c3f tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Getting quotas for project 2c5d24d2b8dc4844a48a76ed2ea2cffe. Resources: {'key_pairs'} {{(pid=124425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 02:43:15.200561 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.quota [None req-7affdb01-e29b-4983-ae2e-5cc3b55a8c3f tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Getting quotas for user f96475caac28419eb0b7dd78375e9e52 and project 2c5d24d2b8dc4844a48a76ed2ea2cffe. Resources: {'key_pairs'} {{(pid=124425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 02:43:15.225994 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-7affdb01-e29b-4983-ae2e-5cc3b55a8c3f tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.218534 Aug 09 02:43:15.226637 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 179/372] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Aug 9 02:43:15 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 02:43:15.321184 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-a37ce238-88a0-4c51-a9af-3987eedfe7bc tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:15.321799 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-a37ce238-88a0-4c51-a9af-3987eedfe7bc tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: b9369cf3-95d7-41d2-8157-ca2c165b062d] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:15.331078 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a37ce238-88a0-4c51-a9af-3987eedfe7bc tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:15.331782 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a37ce238-88a0-4c51-a9af-3987eedfe7bc tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:15.332548 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a37ce238-88a0-4c51-a9af-3987eedfe7bc tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:15.333551 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a37ce238-88a0-4c51-a9af-3987eedfe7bc tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:15.334245 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a37ce238-88a0-4c51-a9af-3987eedfe7bc tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:15.334934 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a37ce238-88a0-4c51-a9af-3987eedfe7bc tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:15.421156 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-0dc2c3a0-3e90-4023-a343-d31447409a3c tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:15.421969 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-0dc2c3a0-3e90-4023-a343-d31447409a3c tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 61f94aa1-75dc-4f43-aa71-284c50dc394c] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:15.432948 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0dc2c3a0-3e90-4023-a343-d31447409a3c tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:15.433446 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0dc2c3a0-3e90-4023-a343-d31447409a3c tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:15.433872 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0dc2c3a0-3e90-4023-a343-d31447409a3c tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:15.434602 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0dc2c3a0-3e90-4023-a343-d31447409a3c tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:15.435200 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0dc2c3a0-3e90-4023-a343-d31447409a3c tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:15.435616 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0dc2c3a0-3e90-4023-a343-d31447409a3c tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:15.441443 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:43:15.540474 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-a37ce238-88a0-4c51-a9af-3987eedfe7bc tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:15.548429 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-a37ce238-88a0-4c51-a9af-3987eedfe7bc tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d" status: 200 len: 1370 microversion: 2.1 time: 0.231114 Aug 09 02:43:15.549011 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 194/373] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:15 2022] GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d => generated 1370 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:43:15.610983 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-0dc2c3a0-3e90-4023-a343-d31447409a3c tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:15.618613 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-0dc2c3a0-3e90-4023-a343-d31447409a3c tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/61f94aa1-75dc-4f43-aa71-284c50dc394c" status: 200 len: 1265 microversion: 2.1 time: 0.217297 Aug 09 02:43:15.619172 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 180/374] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:15 2022] GET /compute/v2.1/servers/61f94aa1-75dc-4f43-aa71-284c50dc394c => generated 1265 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:43:16.565862 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_cell0:SELECT=4 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:43:16.567004 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_cell0:SELECT=14 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:43:16.572865 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-f987ba2e-2461-4623-a3b8-3c765a1d4f60 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:16.573724 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-f987ba2e-2461-4623-a3b8-3c765a1d4f60 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: b9369cf3-95d7-41d2-8157-ca2c165b062d] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:16.581910 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-f987ba2e-2461-4623-a3b8-3c765a1d4f60 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:16.582427 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-f987ba2e-2461-4623-a3b8-3c765a1d4f60 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:16.582868 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-f987ba2e-2461-4623-a3b8-3c765a1d4f60 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:16.583612 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-f987ba2e-2461-4623-a3b8-3c765a1d4f60 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:16.584075 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-f987ba2e-2461-4623-a3b8-3c765a1d4f60 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:16.584556 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-f987ba2e-2461-4623-a3b8-3c765a1d4f60 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:16.639184 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-1a4e08cc-626a-4db6-a821-a5b515a9d1cd tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:16.639782 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-1a4e08cc-626a-4db6-a821-a5b515a9d1cd tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 61f94aa1-75dc-4f43-aa71-284c50dc394c] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:16.646423 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1a4e08cc-626a-4db6-a821-a5b515a9d1cd tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:16.647179 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1a4e08cc-626a-4db6-a821-a5b515a9d1cd tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:16.647762 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1a4e08cc-626a-4db6-a821-a5b515a9d1cd tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:16.648616 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1a4e08cc-626a-4db6-a821-a5b515a9d1cd tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:16.649212 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1a4e08cc-626a-4db6-a821-a5b515a9d1cd tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:16.649777 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1a4e08cc-626a-4db6-a821-a5b515a9d1cd tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:16.800078 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-f987ba2e-2461-4623-a3b8-3c765a1d4f60 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:16.809988 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-f987ba2e-2461-4623-a3b8-3c765a1d4f60 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d" status: 200 len: 1370 microversion: 2.1 time: 0.244882 Aug 09 02:43:16.810740 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 195/375] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:16 2022] GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d => generated 1370 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:43:16.866740 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-1a4e08cc-626a-4db6-a821-a5b515a9d1cd tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:16.876423 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-1a4e08cc-626a-4db6-a821-a5b515a9d1cd tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/61f94aa1-75dc-4f43-aa71-284c50dc394c" status: 200 len: 1265 microversion: 2.1 time: 0.240967 Aug 09 02:43:16.878095 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 181/376] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:16 2022] GET /compute/v2.1/servers/61f94aa1-75dc-4f43-aa71-284c50dc394c => generated 1265 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:43:17.838219 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-5ca8030f-fa87-4b93-acec-087f7dfb8d4e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:17.839342 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-5ca8030f-fa87-4b93-acec-087f7dfb8d4e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: b9369cf3-95d7-41d2-8157-ca2c165b062d] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:17.848490 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5ca8030f-fa87-4b93-acec-087f7dfb8d4e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:17.848978 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5ca8030f-fa87-4b93-acec-087f7dfb8d4e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:17.849405 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5ca8030f-fa87-4b93-acec-087f7dfb8d4e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:17.850097 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5ca8030f-fa87-4b93-acec-087f7dfb8d4e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:17.850747 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5ca8030f-fa87-4b93-acec-087f7dfb8d4e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:17.851815 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5ca8030f-fa87-4b93-acec-087f7dfb8d4e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:17.898728 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-764ad990-45ed-4029-886c-69faf921279d tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:17.899343 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-764ad990-45ed-4029-886c-69faf921279d tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 61f94aa1-75dc-4f43-aa71-284c50dc394c] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:17.907173 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-764ad990-45ed-4029-886c-69faf921279d tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:17.907651 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-764ad990-45ed-4029-886c-69faf921279d tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:17.908286 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-764ad990-45ed-4029-886c-69faf921279d tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:17.909016 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-764ad990-45ed-4029-886c-69faf921279d tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:17.909630 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-764ad990-45ed-4029-886c-69faf921279d tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:17.910239 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-764ad990-45ed-4029-886c-69faf921279d tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:18.055661 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-5ca8030f-fa87-4b93-acec-087f7dfb8d4e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:18.063340 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-5ca8030f-fa87-4b93-acec-087f7dfb8d4e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d" status: 200 len: 1370 microversion: 2.1 time: 0.232173 Aug 09 02:43:18.063909 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 196/377] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:17 2022] GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d => generated 1370 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:43:18.088355 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-764ad990-45ed-4029-886c-69faf921279d tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:18.099270 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-764ad990-45ed-4029-886c-69faf921279d tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/61f94aa1-75dc-4f43-aa71-284c50dc394c" status: 200 len: 1265 microversion: 2.1 time: 0.204660 Aug 09 02:43:18.100087 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 182/378] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:17 2022] GET /compute/v2.1/servers/61f94aa1-75dc-4f43-aa71-284c50dc394c => generated 1265 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:43:18.509146 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [req-a4d958d1-9e47-461d-a43a-80fb23254829 req-2a6eeae7-73bf-4be1-8c29-b365292d5e8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9369cf3-95d7-41d2-8157-ca2c165b062d", "name": "network-vif-plugged", "status": "completed", "tag": "5340ab1c-d934-4cfa-bf83-c7ba28e47a66"}]} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:43:18.522405 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-a4d958d1-9e47-461d-a43a-80fb23254829 req-2a6eeae7-73bf-4be1-8c29-b365292d5e8a service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:18.523258 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-a4d958d1-9e47-461d-a43a-80fb23254829 req-2a6eeae7-73bf-4be1-8c29-b365292d5e8a service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:18.523914 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-a4d958d1-9e47-461d-a43a-80fb23254829 req-2a6eeae7-73bf-4be1-8c29-b365292d5e8a service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:18.539232 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.compute.server_external_events [req-a4d958d1-9e47-461d-a43a-80fb23254829 req-2a6eeae7-73bf-4be1-8c29-b365292d5e8a service nova] Creating event network-vif-plugged:5340ab1c-d934-4cfa-bf83-c7ba28e47a66 for instance b9369cf3-95d7-41d2-8157-ca2c165b062d on hv-cinder-85246 Aug 09 02:43:18.545297 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [req-a4d958d1-9e47-461d-a43a-80fb23254829 req-2a6eeae7-73bf-4be1-8c29-b365292d5e8a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042729 Aug 09 02:43:18.546607 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 197/379] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:43:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:43:19.084655 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-25eed0c7-109b-46c0-bd20-1e8491aaadf5 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:19.085373 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-25eed0c7-109b-46c0-bd20-1e8491aaadf5 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: b9369cf3-95d7-41d2-8157-ca2c165b062d] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:19.092431 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-25eed0c7-109b-46c0-bd20-1e8491aaadf5 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:19.092924 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-25eed0c7-109b-46c0-bd20-1e8491aaadf5 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:19.093326 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-25eed0c7-109b-46c0-bd20-1e8491aaadf5 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:19.094329 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-25eed0c7-109b-46c0-bd20-1e8491aaadf5 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:19.094793 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-25eed0c7-109b-46c0-bd20-1e8491aaadf5 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:19.095311 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-25eed0c7-109b-46c0-bd20-1e8491aaadf5 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:19.124067 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-2461318f-5ee7-4919-8517-80ec58b2a997 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:19.125325 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-2461318f-5ee7-4919-8517-80ec58b2a997 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 61f94aa1-75dc-4f43-aa71-284c50dc394c] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:19.132377 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2461318f-5ee7-4919-8517-80ec58b2a997 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:19.132865 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2461318f-5ee7-4919-8517-80ec58b2a997 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:19.133299 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2461318f-5ee7-4919-8517-80ec58b2a997 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:19.133994 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2461318f-5ee7-4919-8517-80ec58b2a997 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:19.134481 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2461318f-5ee7-4919-8517-80ec58b2a997 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:19.134897 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2461318f-5ee7-4919-8517-80ec58b2a997 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:19.301698 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-25eed0c7-109b-46c0-bd20-1e8491aaadf5 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:19.306119 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-2461318f-5ee7-4919-8517-80ec58b2a997 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:19.309633 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-25eed0c7-109b-46c0-bd20-1e8491aaadf5 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d" status: 200 len: 1370 microversion: 2.1 time: 0.228909 Aug 09 02:43:19.310320 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 183/380] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:19 2022] GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d => generated 1370 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:43:19.314361 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-2461318f-5ee7-4919-8517-80ec58b2a997 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/61f94aa1-75dc-4f43-aa71-284c50dc394c" status: 200 len: 1265 microversion: 2.1 time: 0.194454 Aug 09 02:43:19.314963 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 198/381] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:19 2022] GET /compute/v2.1/servers/61f94aa1-75dc-4f43-aa71-284c50dc394c => generated 1265 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:43:20.332187 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-4df079c8-e85f-448a-9967-49875b38a870 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:20.333075 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-4df079c8-e85f-448a-9967-49875b38a870 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: b9369cf3-95d7-41d2-8157-ca2c165b062d] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:20.335133 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-4a7c8aa0-3e87-49a2-a194-0a7a5045d5de tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:20.336566 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-4a7c8aa0-3e87-49a2-a194-0a7a5045d5de tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 61f94aa1-75dc-4f43-aa71-284c50dc394c] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:20.339258 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:43:20.341898 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4df079c8-e85f-448a-9967-49875b38a870 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:20.342450 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4df079c8-e85f-448a-9967-49875b38a870 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:20.343645 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4df079c8-e85f-448a-9967-49875b38a870 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:20.344603 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4df079c8-e85f-448a-9967-49875b38a870 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:20.345051 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4df079c8-e85f-448a-9967-49875b38a870 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:20.345276 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4a7c8aa0-3e87-49a2-a194-0a7a5045d5de tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:20.345479 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4df079c8-e85f-448a-9967-49875b38a870 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:20.345794 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4a7c8aa0-3e87-49a2-a194-0a7a5045d5de tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:20.346221 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4a7c8aa0-3e87-49a2-a194-0a7a5045d5de tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:20.347147 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4a7c8aa0-3e87-49a2-a194-0a7a5045d5de tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:20.347779 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4a7c8aa0-3e87-49a2-a194-0a7a5045d5de tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:20.348170 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4a7c8aa0-3e87-49a2-a194-0a7a5045d5de tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:20.773989 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-4df079c8-e85f-448a-9967-49875b38a870 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:20.777949 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-4a7c8aa0-3e87-49a2-a194-0a7a5045d5de tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:20.781808 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-4df079c8-e85f-448a-9967-49875b38a870 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d" status: 200 len: 1370 microversion: 2.1 time: 0.455215 Aug 09 02:43:20.782400 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 184/382] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:20 2022] GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d => generated 1370 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:43:20.785878 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-4a7c8aa0-3e87-49a2-a194-0a7a5045d5de tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/61f94aa1-75dc-4f43-aa71-284c50dc394c" status: 200 len: 1265 microversion: 2.1 time: 0.454582 Aug 09 02:43:20.786439 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 199/383] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:20 2022] GET /compute/v2.1/servers/61f94aa1-75dc-4f43-aa71-284c50dc394c => generated 1265 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:43:21.802929 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-aa3b0481-4da4-4904-b2d3-0e3f85e7526b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:21.803592 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-aa3b0481-4da4-4904-b2d3-0e3f85e7526b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: b9369cf3-95d7-41d2-8157-ca2c165b062d] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:21.807558 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-7aabf8d9-9e90-49ec-9fa2-e28820ed4d19 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:21.808150 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-7aabf8d9-9e90-49ec-9fa2-e28820ed4d19 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 61f94aa1-75dc-4f43-aa71-284c50dc394c] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:21.810357 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-aa3b0481-4da4-4904-b2d3-0e3f85e7526b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:21.810918 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-aa3b0481-4da4-4904-b2d3-0e3f85e7526b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:21.811395 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-aa3b0481-4da4-4904-b2d3-0e3f85e7526b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:21.812085 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-aa3b0481-4da4-4904-b2d3-0e3f85e7526b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:21.812532 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-aa3b0481-4da4-4904-b2d3-0e3f85e7526b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:21.812941 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-aa3b0481-4da4-4904-b2d3-0e3f85e7526b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:21.814992 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7aabf8d9-9e90-49ec-9fa2-e28820ed4d19 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:21.815551 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7aabf8d9-9e90-49ec-9fa2-e28820ed4d19 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:21.816040 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7aabf8d9-9e90-49ec-9fa2-e28820ed4d19 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:21.816820 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7aabf8d9-9e90-49ec-9fa2-e28820ed4d19 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:21.817349 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7aabf8d9-9e90-49ec-9fa2-e28820ed4d19 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:21.817874 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7aabf8d9-9e90-49ec-9fa2-e28820ed4d19 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:22.009078 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-aa3b0481-4da4-4904-b2d3-0e3f85e7526b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:22.012510 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-7aabf8d9-9e90-49ec-9fa2-e28820ed4d19 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:22.017007 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-aa3b0481-4da4-4904-b2d3-0e3f85e7526b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d" status: 200 len: 1563 microversion: 2.1 time: 0.218222 Aug 09 02:43:22.017555 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 185/384] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:21 2022] GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d => generated 1563 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:43:22.020401 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-7aabf8d9-9e90-49ec-9fa2-e28820ed4d19 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/61f94aa1-75dc-4f43-aa71-284c50dc394c" status: 200 len: 1265 microversion: 2.1 time: 0.217400 Aug 09 02:43:22.020988 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 200/385] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:21 2022] GET /compute/v2.1/servers/61f94aa1-75dc-4f43-aa71-284c50dc394c => generated 1265 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:43:22.037060 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-cfff979a-0c37-4535-98d7-4ded093ab432 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:22.037547 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-cfff979a-0c37-4535-98d7-4ded093ab432 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: b9369cf3-95d7-41d2-8157-ca2c165b062d] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:22.043648 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-cfff979a-0c37-4535-98d7-4ded093ab432 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:22.044126 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-cfff979a-0c37-4535-98d7-4ded093ab432 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:22.044559 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-cfff979a-0c37-4535-98d7-4ded093ab432 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:22.045247 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-cfff979a-0c37-4535-98d7-4ded093ab432 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:22.045757 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-cfff979a-0c37-4535-98d7-4ded093ab432 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:22.046084 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-cfff979a-0c37-4535-98d7-4ded093ab432 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:22.124005 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-cfff979a-0c37-4535-98d7-4ded093ab432 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090801 Aug 09 02:43:22.124632 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 186/386] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Aug 9 02:43:22 2022] GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:43:22.840208 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [req-5e268041-9faf-4368-8330-7df451b22bc1 req-75d9213d-bd2e-4343-95e1-4b26920c4f03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61f94aa1-75dc-4f43-aa71-284c50dc394c", "name": "network-vif-plugged", "status": "completed", "tag": "02b344f5-9ec1-4ff5-8e96-c217038c81a6"}]} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:43:22.851372 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-5e268041-9faf-4368-8330-7df451b22bc1 req-75d9213d-bd2e-4343-95e1-4b26920c4f03 service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:22.851814 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-5e268041-9faf-4368-8330-7df451b22bc1 req-75d9213d-bd2e-4343-95e1-4b26920c4f03 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:22.852534 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-5e268041-9faf-4368-8330-7df451b22bc1 req-75d9213d-bd2e-4343-95e1-4b26920c4f03 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:22.865230 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.compute.server_external_events [req-5e268041-9faf-4368-8330-7df451b22bc1 req-75d9213d-bd2e-4343-95e1-4b26920c4f03 service nova] Creating event network-vif-plugged:02b344f5-9ec1-4ff5-8e96-c217038c81a6 for instance 61f94aa1-75dc-4f43-aa71-284c50dc394c on hv-cinder-85246 Aug 09 02:43:22.871358 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [req-5e268041-9faf-4368-8330-7df451b22bc1 req-75d9213d-bd2e-4343-95e1-4b26920c4f03 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035221 Aug 09 02:43:22.872156 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 201/387] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:43:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:43:23.041924 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-2a74db8a-7436-4048-bc13-0ba9b05553f7 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:23.042626 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-2a74db8a-7436-4048-bc13-0ba9b05553f7 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 61f94aa1-75dc-4f43-aa71-284c50dc394c] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:23.049153 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2a74db8a-7436-4048-bc13-0ba9b05553f7 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:23.049767 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2a74db8a-7436-4048-bc13-0ba9b05553f7 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:23.050368 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2a74db8a-7436-4048-bc13-0ba9b05553f7 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:23.051129 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2a74db8a-7436-4048-bc13-0ba9b05553f7 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:23.051611 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2a74db8a-7436-4048-bc13-0ba9b05553f7 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:23.052027 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2a74db8a-7436-4048-bc13-0ba9b05553f7 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:23.218547 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-2a74db8a-7436-4048-bc13-0ba9b05553f7 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:23.226175 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-2a74db8a-7436-4048-bc13-0ba9b05553f7 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/61f94aa1-75dc-4f43-aa71-284c50dc394c" status: 200 len: 1265 microversion: 2.1 time: 0.188638 Aug 09 02:43:23.227014 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 187/388] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:23 2022] GET /compute/v2.1/servers/61f94aa1-75dc-4f43-aa71-284c50dc394c => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:43:23.350424 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [req-ff75b349-bfd5-4d63-ae2c-e2dce1a41a3b req-e573cf15-846a-4d85-a0ad-dbf9a8fca6e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9369cf3-95d7-41d2-8157-ca2c165b062d", "tag": "5340ab1c-d934-4cfa-bf83-c7ba28e47a66"}]} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:43:23.362249 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-ff75b349-bfd5-4d63-ae2c-e2dce1a41a3b req-e573cf15-846a-4d85-a0ad-dbf9a8fca6e5 service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:23.363020 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-ff75b349-bfd5-4d63-ae2c-e2dce1a41a3b req-e573cf15-846a-4d85-a0ad-dbf9a8fca6e5 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:23.363510 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-ff75b349-bfd5-4d63-ae2c-e2dce1a41a3b req-e573cf15-846a-4d85-a0ad-dbf9a8fca6e5 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:23.378430 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.compute.server_external_events [req-ff75b349-bfd5-4d63-ae2c-e2dce1a41a3b req-e573cf15-846a-4d85-a0ad-dbf9a8fca6e5 service nova] Creating event network-changed:5340ab1c-d934-4cfa-bf83-c7ba28e47a66 for instance b9369cf3-95d7-41d2-8157-ca2c165b062d on hv-cinder-85246 Aug 09 02:43:23.384106 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [req-ff75b349-bfd5-4d63-ae2c-e2dce1a41a3b req-e573cf15-846a-4d85-a0ad-dbf9a8fca6e5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037541 Aug 09 02:43:23.385090 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 202/389] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:43:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:43:24.248204 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-4949e169-d67a-4ac0-991e-541551b2cfc6 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:24.249489 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-4949e169-d67a-4ac0-991e-541551b2cfc6 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 61f94aa1-75dc-4f43-aa71-284c50dc394c] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:24.256434 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4949e169-d67a-4ac0-991e-541551b2cfc6 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:24.256920 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4949e169-d67a-4ac0-991e-541551b2cfc6 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:24.257352 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4949e169-d67a-4ac0-991e-541551b2cfc6 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:24.258047 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4949e169-d67a-4ac0-991e-541551b2cfc6 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:24.258542 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4949e169-d67a-4ac0-991e-541551b2cfc6 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:24.258959 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4949e169-d67a-4ac0-991e-541551b2cfc6 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:24.399803 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-4949e169-d67a-4ac0-991e-541551b2cfc6 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:24.411859 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-4949e169-d67a-4ac0-991e-541551b2cfc6 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/61f94aa1-75dc-4f43-aa71-284c50dc394c" status: 200 len: 1265 microversion: 2.1 time: 0.167397 Aug 09 02:43:24.412863 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 188/390] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:24 2022] GET /compute/v2.1/servers/61f94aa1-75dc-4f43-aa71-284c50dc394c => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:43:25.433732 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-4a2fd1e7-bcc8-4f5d-933a-90c1ba2e0561 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:25.434450 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-4a2fd1e7-bcc8-4f5d-933a-90c1ba2e0561 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 61f94aa1-75dc-4f43-aa71-284c50dc394c] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:25.441545 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4a2fd1e7-bcc8-4f5d-933a-90c1ba2e0561 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:25.442022 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4a2fd1e7-bcc8-4f5d-933a-90c1ba2e0561 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:25.442482 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4a2fd1e7-bcc8-4f5d-933a-90c1ba2e0561 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:25.443158 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4a2fd1e7-bcc8-4f5d-933a-90c1ba2e0561 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:25.443601 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4a2fd1e7-bcc8-4f5d-933a-90c1ba2e0561 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:25.444020 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4a2fd1e7-bcc8-4f5d-933a-90c1ba2e0561 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:25.582134 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-4a2fd1e7-bcc8-4f5d-933a-90c1ba2e0561 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:25.590738 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-4a2fd1e7-bcc8-4f5d-933a-90c1ba2e0561 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/61f94aa1-75dc-4f43-aa71-284c50dc394c" status: 200 len: 1453 microversion: 2.1 time: 0.161252 Aug 09 02:43:25.591315 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 203/391] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:25 2022] GET /compute/v2.1/servers/61f94aa1-75dc-4f43-aa71-284c50dc394c => generated 1453 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:43:25.611351 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-2f2875d3-3a5f-4a73-bf50-c07dc9b13775 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:25.611986 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-2f2875d3-3a5f-4a73-bf50-c07dc9b13775 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 61f94aa1-75dc-4f43-aa71-284c50dc394c] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:25.613900 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_cell0:SELECT=10 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:43:25.620029 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2f2875d3-3a5f-4a73-bf50-c07dc9b13775 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:25.620517 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2f2875d3-3a5f-4a73-bf50-c07dc9b13775 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:25.620930 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2f2875d3-3a5f-4a73-bf50-c07dc9b13775 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:25.621607 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2f2875d3-3a5f-4a73-bf50-c07dc9b13775 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:25.622048 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2f2875d3-3a5f-4a73-bf50-c07dc9b13775 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:25.622502 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2f2875d3-3a5f-4a73-bf50-c07dc9b13775 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:25.760235 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-2f2875d3-3a5f-4a73-bf50-c07dc9b13775 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:25.771231 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-2f2875d3-3a5f-4a73-bf50-c07dc9b13775 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/61f94aa1-75dc-4f43-aa71-284c50dc394c" status: 200 len: 1453 microversion: 2.1 time: 0.163820 Aug 09 02:43:25.771862 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 189/392] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:25 2022] GET /compute/v2.1/servers/61f94aa1-75dc-4f43-aa71-284c50dc394c => generated 1453 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:43:27.543802 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [req-0c079a56-cf54-4e48-81c7-6a78847df4e6 req-41347f6c-bfb5-4197-8ee2-7268a705cd73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61f94aa1-75dc-4f43-aa71-284c50dc394c", "tag": "02b344f5-9ec1-4ff5-8e96-c217038c81a6"}]} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:43:27.553978 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-0c079a56-cf54-4e48-81c7-6a78847df4e6 req-41347f6c-bfb5-4197-8ee2-7268a705cd73 service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:27.553978 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-0c079a56-cf54-4e48-81c7-6a78847df4e6 req-41347f6c-bfb5-4197-8ee2-7268a705cd73 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:27.554289 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-0c079a56-cf54-4e48-81c7-6a78847df4e6 req-41347f6c-bfb5-4197-8ee2-7268a705cd73 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:27.565540 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.compute.server_external_events [req-0c079a56-cf54-4e48-81c7-6a78847df4e6 req-41347f6c-bfb5-4197-8ee2-7268a705cd73 service nova] Creating event network-changed:02b344f5-9ec1-4ff5-8e96-c217038c81a6 for instance 61f94aa1-75dc-4f43-aa71-284c50dc394c on hv-cinder-85246 Aug 09 02:43:27.570630 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [req-0c079a56-cf54-4e48-81c7-6a78847df4e6 req-41347f6c-bfb5-4197-8ee2-7268a705cd73 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030392 Aug 09 02:43:27.571568 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 204/393] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:43:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:43:32.181240 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-eecd7993-99a3-4dbd-926d-b0d51c384c15 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:43:32.184976 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-eecd7993-99a3-4dbd-926d-b0d51c384c15 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] [instance: 7cfae5d5-8846-4c6d-8e56-5a52f817b48e] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:32.189016 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=2 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:43:32.197935 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-eecd7993-99a3-4dbd-926d-b0d51c384c15 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:32.198754 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-eecd7993-99a3-4dbd-926d-b0d51c384c15 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:32.199449 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-eecd7993-99a3-4dbd-926d-b0d51c384c15 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:32.200556 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-eecd7993-99a3-4dbd-926d-b0d51c384c15 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:32.201284 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-eecd7993-99a3-4dbd-926d-b0d51c384c15 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:32.201963 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-eecd7993-99a3-4dbd-926d-b0d51c384c15 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:32.278759 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-eecd7993-99a3-4dbd-926d-b0d51c384c15 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] 10.222.0.20 "POST /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e/action" status: 202 len: 0 microversion: 2.1 time: 0.104029 Aug 09 02:43:32.279398 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 190/394] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Aug 9 02:43:32 2022] POST /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 02:43:32.288224 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-92b3d8ed-d8ac-402e-874b-c0b8f8a02ece tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:32.289094 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-92b3d8ed-d8ac-402e-874b-c0b8f8a02ece tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] [instance: 7cfae5d5-8846-4c6d-8e56-5a52f817b48e] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:32.295997 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-92b3d8ed-d8ac-402e-874b-c0b8f8a02ece tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:32.296564 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-92b3d8ed-d8ac-402e-874b-c0b8f8a02ece tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:32.296991 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-92b3d8ed-d8ac-402e-874b-c0b8f8a02ece tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:32.297694 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-92b3d8ed-d8ac-402e-874b-c0b8f8a02ece tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:32.298240 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-92b3d8ed-d8ac-402e-874b-c0b8f8a02ece tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:32.298661 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-92b3d8ed-d8ac-402e-874b-c0b8f8a02ece tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:32.489395 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-92b3d8ed-d8ac-402e-874b-c0b8f8a02ece tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6b64eb434414ab61f19b170385c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5508bdf5e4577b49783c3e424f1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:32.497827 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-92b3d8ed-d8ac-402e-874b-c0b8f8a02ece tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] 10.222.0.20 "GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e" status: 200 len: 1750 microversion: 2.1 time: 0.214080 Aug 09 02:43:32.498418 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 205/395] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:32 2022] GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e => generated 1750 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:43:33.525710 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-840b5805-3442-40da-817d-a3dfb98203d2 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:33.526914 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-840b5805-3442-40da-817d-a3dfb98203d2 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] [instance: 7cfae5d5-8846-4c6d-8e56-5a52f817b48e] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:33.536558 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-840b5805-3442-40da-817d-a3dfb98203d2 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:33.537030 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-840b5805-3442-40da-817d-a3dfb98203d2 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:33.537452 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-840b5805-3442-40da-817d-a3dfb98203d2 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:33.538136 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-840b5805-3442-40da-817d-a3dfb98203d2 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:33.538607 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-840b5805-3442-40da-817d-a3dfb98203d2 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:33.539017 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-840b5805-3442-40da-817d-a3dfb98203d2 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:33.690290 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-840b5805-3442-40da-817d-a3dfb98203d2 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6b64eb434414ab61f19b170385c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5508bdf5e4577b49783c3e424f1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:33.698733 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-840b5805-3442-40da-817d-a3dfb98203d2 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] 10.222.0.20 "GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e" status: 200 len: 1755 microversion: 2.1 time: 0.180952 Aug 09 02:43:33.699340 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 191/396] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:33 2022] GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e => generated 1755 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:43:34.723864 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-c16da5d4-56fe-46f5-b3d5-d271d0724ebc tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:34.724487 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-c16da5d4-56fe-46f5-b3d5-d271d0724ebc tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] [instance: 7cfae5d5-8846-4c6d-8e56-5a52f817b48e] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:34.731504 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-c16da5d4-56fe-46f5-b3d5-d271d0724ebc tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:34.732490 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-c16da5d4-56fe-46f5-b3d5-d271d0724ebc tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:34.732909 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-c16da5d4-56fe-46f5-b3d5-d271d0724ebc tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:34.733428 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-c16da5d4-56fe-46f5-b3d5-d271d0724ebc tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:34.733877 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-c16da5d4-56fe-46f5-b3d5-d271d0724ebc tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:34.734325 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-c16da5d4-56fe-46f5-b3d5-d271d0724ebc tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:34.737034 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_cell1:SELECT=100 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:43:34.884043 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-c16da5d4-56fe-46f5-b3d5-d271d0724ebc tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6b64eb434414ab61f19b170385c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5508bdf5e4577b49783c3e424f1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:34.892078 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-c16da5d4-56fe-46f5-b3d5-d271d0724ebc tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] 10.222.0.20 "GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e" status: 200 len: 1755 microversion: 2.1 time: 0.173960 Aug 09 02:43:34.892644 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 206/397] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:34 2022] GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:43:35.922398 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-7693ff88-a096-4406-9542-a9822a5114fb tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:35.922989 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-7693ff88-a096-4406-9542-a9822a5114fb tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] [instance: 7cfae5d5-8846-4c6d-8e56-5a52f817b48e] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:35.930413 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7693ff88-a096-4406-9542-a9822a5114fb tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:35.930885 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7693ff88-a096-4406-9542-a9822a5114fb tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:35.931308 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7693ff88-a096-4406-9542-a9822a5114fb tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:35.931979 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7693ff88-a096-4406-9542-a9822a5114fb tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:35.932416 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7693ff88-a096-4406-9542-a9822a5114fb tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:35.932824 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7693ff88-a096-4406-9542-a9822a5114fb tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:36.089615 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-7693ff88-a096-4406-9542-a9822a5114fb tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6b64eb434414ab61f19b170385c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5508bdf5e4577b49783c3e424f1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:36.102144 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-7693ff88-a096-4406-9542-a9822a5114fb tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] 10.222.0.20 "GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e" status: 200 len: 1755 microversion: 2.1 time: 0.185835 Aug 09 02:43:36.102858 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 192/398] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:35 2022] GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e => generated 1755 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:43:37.128811 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-e0f41ddd-2ca2-4d36-a324-f40535edd2e2 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:37.129725 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-e0f41ddd-2ca2-4d36-a324-f40535edd2e2 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] [instance: 7cfae5d5-8846-4c6d-8e56-5a52f817b48e] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:37.136749 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e0f41ddd-2ca2-4d36-a324-f40535edd2e2 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:37.137289 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e0f41ddd-2ca2-4d36-a324-f40535edd2e2 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:37.137768 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e0f41ddd-2ca2-4d36-a324-f40535edd2e2 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:37.138569 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e0f41ddd-2ca2-4d36-a324-f40535edd2e2 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:37.139069 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e0f41ddd-2ca2-4d36-a324-f40535edd2e2 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:37.139537 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e0f41ddd-2ca2-4d36-a324-f40535edd2e2 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:37.293292 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-e0f41ddd-2ca2-4d36-a324-f40535edd2e2 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6b64eb434414ab61f19b170385c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5508bdf5e4577b49783c3e424f1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:37.301775 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-e0f41ddd-2ca2-4d36-a324-f40535edd2e2 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] 10.222.0.20 "GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e" status: 200 len: 1755 microversion: 2.1 time: 0.179724 Aug 09 02:43:37.302381 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 207/399] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:37 2022] GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e => generated 1755 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:43:37.963579 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-b0218854-9a1c-4385-8f68-3e21672c07c3 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-987137434", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2001242133", "security_groups": [{"name": "tempest-secgroup-smoke-1998737444"}], "networks": [{"uuid": "203a1ebe-9623-4a72-9e02-1995592d7f43"}], "block_device_mapping_v2": [{"uuid": "41d9817d-65a2-4950-ab6c-8a6d5611eb6a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:43:38.082296 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.network.neutron [None req-b0218854-9a1c-4385-8f68-3e21672c07c3 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] validate_networks() for [('203a1ebe-9623-4a72-9e02-1995592d7f43', None, None, None, None, None)] {{(pid=124425) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 02:43:38.328730 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-c44e5451-b621-4100-b05b-f24610a7c880 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:38.329324 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-c44e5451-b621-4100-b05b-f24610a7c880 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] [instance: 7cfae5d5-8846-4c6d-8e56-5a52f817b48e] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:38.337267 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-c44e5451-b621-4100-b05b-f24610a7c880 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:38.337756 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-c44e5451-b621-4100-b05b-f24610a7c880 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:38.338186 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-c44e5451-b621-4100-b05b-f24610a7c880 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:38.338909 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-c44e5451-b621-4100-b05b-f24610a7c880 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:38.339352 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-c44e5451-b621-4100-b05b-f24610a7c880 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:38.339952 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-c44e5451-b621-4100-b05b-f24610a7c880 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:38.709251 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-c44e5451-b621-4100-b05b-f24610a7c880 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6b64eb434414ab61f19b170385c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5508bdf5e4577b49783c3e424f1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:38.717983 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-c44e5451-b621-4100-b05b-f24610a7c880 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] 10.222.0.20 "GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e" status: 200 len: 1755 microversion: 2.1 time: 0.393302 Aug 09 02:43:38.718602 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 208/400] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:38 2022] GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e => generated 1755 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:43:38.745135 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.virt.hardware [None req-b0218854-9a1c-4385-8f68-3e21672c07c3 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Flavor limits 0:0:0 {{(pid=124425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 02:43:38.745547 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.virt.hardware [None req-b0218854-9a1c-4385-8f68-3e21672c07c3 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Image limits 0:0:0 {{(pid=124425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 02:43:38.746007 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.virt.hardware [None req-b0218854-9a1c-4385-8f68-3e21672c07c3 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Flavor pref 0:0:0 {{(pid=124425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 02:43:38.746486 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.virt.hardware [None req-b0218854-9a1c-4385-8f68-3e21672c07c3 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Image pref 0:0:0 {{(pid=124425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 02:43:38.746885 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.virt.hardware [None req-b0218854-9a1c-4385-8f68-3e21672c07c3 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 02:43:38.755963 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b0218854-9a1c-4385-8f68-3e21672c07c3 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:38.756432 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b0218854-9a1c-4385-8f68-3e21672c07c3 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:38.756851 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b0218854-9a1c-4385-8f68-3e21672c07c3 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:38.757555 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b0218854-9a1c-4385-8f68-3e21672c07c3 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:38.757993 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b0218854-9a1c-4385-8f68-3e21672c07c3 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:38.758432 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b0218854-9a1c-4385-8f68-3e21672c07c3 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:38.775192 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.quota [None req-b0218854-9a1c-4385-8f68-3e21672c07c3 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Getting quotas for project 2c5d24d2b8dc4844a48a76ed2ea2cffe. Resources: {'cores', 'ram', 'instances'} {{(pid=124425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 02:43:38.779120 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.quota [None req-b0218854-9a1c-4385-8f68-3e21672c07c3 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Getting quotas for user f96475caac28419eb0b7dd78375e9e52 and project 2c5d24d2b8dc4844a48a76ed2ea2cffe. Resources: {'cores', 'ram', 'instances'} {{(pid=124425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 02:43:38.844349 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-b0218854-9a1c-4385-8f68-3e21672c07c3 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Going to run 1 instances... {{(pid=124425) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 02:43:38.846495 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-b0218854-9a1c-4385-8f68-3e21672c07c3 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] [instance: 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='41d9817d-65a2-4950-ab6c-8a6d5611eb6a',volume_size=None,volume_type=None)] {{(pid=124425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 02:43:38.983670 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-b0218854-9a1c-4385-8f68-3e21672c07c3 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.023944 Aug 09 02:43:38.984639 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 193/401] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Aug 9 02:43:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 1025 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 02:43:38.995202 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-ac5210f3-ca28-4518-a175-ab0c523e5130 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:38.995816 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-ac5210f3-ca28-4518-a175-ab0c523e5130 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] [instance: 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:39.050605 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-ac5210f3-ca28-4518-a175-ab0c523e5130 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96475caac28419eb0b7dd78375e9e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5d24d2b8dc4844a48a76ed2ea2cffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:39.058725 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-ac5210f3-ca28-4518-a175-ab0c523e5130 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] 10.222.0.20 "GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b" status: 200 len: 1088 microversion: 2.1 time: 0.067441 Aug 09 02:43:39.059291 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 209/402] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:38 2022] GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b => generated 1088 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:43:39.740206 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-f3ff6e8c-d1e6-4f2c-9935-c2105bab2873 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:39.741060 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-f3ff6e8c-d1e6-4f2c-9935-c2105bab2873 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] [instance: 7cfae5d5-8846-4c6d-8e56-5a52f817b48e] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:39.749439 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f3ff6e8c-d1e6-4f2c-9935-c2105bab2873 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:39.750076 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f3ff6e8c-d1e6-4f2c-9935-c2105bab2873 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:39.750690 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f3ff6e8c-d1e6-4f2c-9935-c2105bab2873 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:39.751611 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f3ff6e8c-d1e6-4f2c-9935-c2105bab2873 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:39.752216 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f3ff6e8c-d1e6-4f2c-9935-c2105bab2873 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:39.752769 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f3ff6e8c-d1e6-4f2c-9935-c2105bab2873 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:39.908358 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-f3ff6e8c-d1e6-4f2c-9935-c2105bab2873 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6b64eb434414ab61f19b170385c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5508bdf5e4577b49783c3e424f1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:39.916431 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-f3ff6e8c-d1e6-4f2c-9935-c2105bab2873 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] 10.222.0.20 "GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e" status: 200 len: 1755 microversion: 2.1 time: 0.180458 Aug 09 02:43:39.916993 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 194/403] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:39 2022] GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e => generated 1755 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:43:40.079618 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-0efc137e-b724-4c55-88f5-6fc29327e09a tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:40.080230 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-0efc137e-b724-4c55-88f5-6fc29327e09a tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] [instance: 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:40.087712 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0efc137e-b724-4c55-88f5-6fc29327e09a tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:40.088198 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0efc137e-b724-4c55-88f5-6fc29327e09a tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:40.088627 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0efc137e-b724-4c55-88f5-6fc29327e09a tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:40.089319 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0efc137e-b724-4c55-88f5-6fc29327e09a tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:40.089769 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0efc137e-b724-4c55-88f5-6fc29327e09a tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:40.090195 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0efc137e-b724-4c55-88f5-6fc29327e09a tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:40.152370 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-0efc137e-b724-4c55-88f5-6fc29327e09a tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96475caac28419eb0b7dd78375e9e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5d24d2b8dc4844a48a76ed2ea2cffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:40.160068 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-0efc137e-b724-4c55-88f5-6fc29327e09a tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] 10.222.0.20 "GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b" status: 200 len: 1186 microversion: 2.1 time: 0.084310 Aug 09 02:43:40.160639 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 210/404] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:40 2022] GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b => generated 1186 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:43:40.939484 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-6d58fd97-887e-4167-95d3-ba10e6c7d065 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:40.940102 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-6d58fd97-887e-4167-95d3-ba10e6c7d065 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] [instance: 7cfae5d5-8846-4c6d-8e56-5a52f817b48e] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:40.947443 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6d58fd97-887e-4167-95d3-ba10e6c7d065 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:40.948010 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6d58fd97-887e-4167-95d3-ba10e6c7d065 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:40.948510 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6d58fd97-887e-4167-95d3-ba10e6c7d065 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:40.949523 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6d58fd97-887e-4167-95d3-ba10e6c7d065 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:40.950053 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6d58fd97-887e-4167-95d3-ba10e6c7d065 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:40.950559 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6d58fd97-887e-4167-95d3-ba10e6c7d065 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:41.172061 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-6d58fd97-887e-4167-95d3-ba10e6c7d065 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6b64eb434414ab61f19b170385c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5508bdf5e4577b49783c3e424f1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:41.180850 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-6d58fd97-887e-4167-95d3-ba10e6c7d065 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] 10.222.0.20 "GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e" status: 200 len: 1755 microversion: 2.1 time: 0.246074 Aug 09 02:43:41.181362 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-a7ec0577-9ca8-4532-9c1b-8bf6625aa84d tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:41.181903 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 195/405] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:40 2022] GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e => generated 1755 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:43:41.182798 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-a7ec0577-9ca8-4532-9c1b-8bf6625aa84d tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] [instance: 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:41.189355 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a7ec0577-9ca8-4532-9c1b-8bf6625aa84d tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:41.190061 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a7ec0577-9ca8-4532-9c1b-8bf6625aa84d tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:41.190735 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a7ec0577-9ca8-4532-9c1b-8bf6625aa84d tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:41.191621 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a7ec0577-9ca8-4532-9c1b-8bf6625aa84d tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:41.192284 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a7ec0577-9ca8-4532-9c1b-8bf6625aa84d tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:41.192831 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a7ec0577-9ca8-4532-9c1b-8bf6625aa84d tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:41.259059 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-a7ec0577-9ca8-4532-9c1b-8bf6625aa84d tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96475caac28419eb0b7dd78375e9e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5d24d2b8dc4844a48a76ed2ea2cffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:41.266674 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-a7ec0577-9ca8-4532-9c1b-8bf6625aa84d tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] 10.222.0.20 "GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b" status: 200 len: 1204 microversion: 2.1 time: 0.089541 Aug 09 02:43:41.267219 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 211/406] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:41 2022] GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b => generated 1204 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:43:42.169717 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [req-4ed77782-497f-4ca5-b9c1-21c0226d80d9 req-e0e9f1e0-6e11-4c15-8570-a128e4111a4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b", "tag": "f12d9ad9-133b-4098-a94d-fd5f540a9f7c"}]} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:43:42.180040 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-4ed77782-497f-4ca5-b9c1-21c0226d80d9 req-e0e9f1e0-6e11-4c15-8570-a128e4111a4a service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:42.180427 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-4ed77782-497f-4ca5-b9c1-21c0226d80d9 req-e0e9f1e0-6e11-4c15-8570-a128e4111a4a service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:42.181082 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-4ed77782-497f-4ca5-b9c1-21c0226d80d9 req-e0e9f1e0-6e11-4c15-8570-a128e4111a4a service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:42.191983 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.compute.server_external_events [req-4ed77782-497f-4ca5-b9c1-21c0226d80d9 req-e0e9f1e0-6e11-4c15-8570-a128e4111a4a service nova] Creating event network-changed:f12d9ad9-133b-4098-a94d-fd5f540a9f7c for instance 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b on hv-cinder-85246 Aug 09 02:43:42.196994 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [req-4ed77782-497f-4ca5-b9c1-21c0226d80d9 req-e0e9f1e0-6e11-4c15-8570-a128e4111a4a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030985 Aug 09 02:43:42.197599 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 196/407] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:43:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:43:42.203317 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-fbeac9ea-cdc3-4d38-a461-257a6bbe9f4a tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:42.204072 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-fbeac9ea-cdc3-4d38-a461-257a6bbe9f4a tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] [instance: 7cfae5d5-8846-4c6d-8e56-5a52f817b48e] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:42.211355 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-fbeac9ea-cdc3-4d38-a461-257a6bbe9f4a tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:42.211827 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-fbeac9ea-cdc3-4d38-a461-257a6bbe9f4a tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:42.212251 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-fbeac9ea-cdc3-4d38-a461-257a6bbe9f4a tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:42.213561 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-fbeac9ea-cdc3-4d38-a461-257a6bbe9f4a tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:42.214047 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-fbeac9ea-cdc3-4d38-a461-257a6bbe9f4a tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:42.214661 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-fbeac9ea-cdc3-4d38-a461-257a6bbe9f4a tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:42.289549 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-3649451d-a2fb-43eb-9dc6-dc95f5e3426a tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:42.290244 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-3649451d-a2fb-43eb-9dc6-dc95f5e3426a tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] [instance: 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:42.296988 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3649451d-a2fb-43eb-9dc6-dc95f5e3426a tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:42.297445 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3649451d-a2fb-43eb-9dc6-dc95f5e3426a tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:42.297902 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3649451d-a2fb-43eb-9dc6-dc95f5e3426a tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:42.298598 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3649451d-a2fb-43eb-9dc6-dc95f5e3426a tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:42.299071 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3649451d-a2fb-43eb-9dc6-dc95f5e3426a tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:42.299486 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3649451d-a2fb-43eb-9dc6-dc95f5e3426a tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:42.315187 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:43:42.507577 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-fbeac9ea-cdc3-4d38-a461-257a6bbe9f4a tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6b64eb434414ab61f19b170385c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5508bdf5e4577b49783c3e424f1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:42.515708 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-fbeac9ea-cdc3-4d38-a461-257a6bbe9f4a tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] 10.222.0.20 "GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e" status: 200 len: 1755 microversion: 2.1 time: 0.316781 Aug 09 02:43:42.516248 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 212/408] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:42 2022] GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e => generated 1755 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:43:42.553486 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-3649451d-a2fb-43eb-9dc6-dc95f5e3426a tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96475caac28419eb0b7dd78375e9e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5d24d2b8dc4844a48a76ed2ea2cffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:42.561448 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-3649451d-a2fb-43eb-9dc6-dc95f5e3426a tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] 10.222.0.20 "GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b" status: 200 len: 1260 microversion: 2.1 time: 0.276237 Aug 09 02:43:42.562182 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 197/409] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:42 2022] GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b => generated 1260 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:43:43.537290 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-a502fb60-3fac-414b-ae1e-3b6a0ce3cd49 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:43.537908 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-a502fb60-3fac-414b-ae1e-3b6a0ce3cd49 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] [instance: 7cfae5d5-8846-4c6d-8e56-5a52f817b48e] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:43.544918 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a502fb60-3fac-414b-ae1e-3b6a0ce3cd49 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:43.545366 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a502fb60-3fac-414b-ae1e-3b6a0ce3cd49 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:43.546013 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a502fb60-3fac-414b-ae1e-3b6a0ce3cd49 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:43.546736 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a502fb60-3fac-414b-ae1e-3b6a0ce3cd49 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:43.547183 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a502fb60-3fac-414b-ae1e-3b6a0ce3cd49 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:43.547606 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a502fb60-3fac-414b-ae1e-3b6a0ce3cd49 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:43.582532 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-65e6fa8f-eb83-4d64-9931-3bcb2a54aa57 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:43.583213 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-65e6fa8f-eb83-4d64-9931-3bcb2a54aa57 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] [instance: 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:43.590568 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-65e6fa8f-eb83-4d64-9931-3bcb2a54aa57 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:43.591156 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-65e6fa8f-eb83-4d64-9931-3bcb2a54aa57 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:43.591652 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-65e6fa8f-eb83-4d64-9931-3bcb2a54aa57 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:43.592411 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-65e6fa8f-eb83-4d64-9931-3bcb2a54aa57 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:43.592922 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-65e6fa8f-eb83-4d64-9931-3bcb2a54aa57 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:43.593401 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-65e6fa8f-eb83-4d64-9931-3bcb2a54aa57 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:43.756048 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-a502fb60-3fac-414b-ae1e-3b6a0ce3cd49 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6b64eb434414ab61f19b170385c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5508bdf5e4577b49783c3e424f1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:43.764562 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-a502fb60-3fac-414b-ae1e-3b6a0ce3cd49 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] 10.222.0.20 "GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e" status: 200 len: 1755 microversion: 2.1 time: 0.231236 Aug 09 02:43:43.765230 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 213/410] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:43 2022] GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e => generated 1755 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:43:43.812908 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-65e6fa8f-eb83-4d64-9931-3bcb2a54aa57 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96475caac28419eb0b7dd78375e9e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5d24d2b8dc4844a48a76ed2ea2cffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:43.821417 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-65e6fa8f-eb83-4d64-9931-3bcb2a54aa57 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] 10.222.0.20 "GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b" status: 200 len: 1260 microversion: 2.1 time: 0.242715 Aug 09 02:43:43.821986 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 198/411] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:43 2022] GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b => generated 1260 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:43:44.790567 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-7d274f83-9e57-4b37-8683-bb5190af107c tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:44.791513 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-7d274f83-9e57-4b37-8683-bb5190af107c tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] [instance: 7cfae5d5-8846-4c6d-8e56-5a52f817b48e] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:44.802596 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7d274f83-9e57-4b37-8683-bb5190af107c tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:44.803467 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7d274f83-9e57-4b37-8683-bb5190af107c tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:44.803901 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7d274f83-9e57-4b37-8683-bb5190af107c tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:44.804585 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7d274f83-9e57-4b37-8683-bb5190af107c tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:44.805036 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7d274f83-9e57-4b37-8683-bb5190af107c tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:44.805457 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7d274f83-9e57-4b37-8683-bb5190af107c tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:44.842021 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-e82e6549-bbfa-4e66-bcc6-362ffcd04f87 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:44.842691 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-e82e6549-bbfa-4e66-bcc6-362ffcd04f87 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] [instance: 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:44.849451 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e82e6549-bbfa-4e66-bcc6-362ffcd04f87 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:44.849936 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e82e6549-bbfa-4e66-bcc6-362ffcd04f87 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:44.850677 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e82e6549-bbfa-4e66-bcc6-362ffcd04f87 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:44.851403 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e82e6549-bbfa-4e66-bcc6-362ffcd04f87 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:44.851850 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e82e6549-bbfa-4e66-bcc6-362ffcd04f87 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:44.852267 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e82e6549-bbfa-4e66-bcc6-362ffcd04f87 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:45.002768 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-7d274f83-9e57-4b37-8683-bb5190af107c tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6b64eb434414ab61f19b170385c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5508bdf5e4577b49783c3e424f1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:45.011647 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-7d274f83-9e57-4b37-8683-bb5190af107c tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] 10.222.0.20 "GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e" status: 200 len: 1755 microversion: 2.1 time: 0.227774 Aug 09 02:43:45.012424 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 214/412] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:44 2022] GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e => generated 1755 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:43:45.027809 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-e82e6549-bbfa-4e66-bcc6-362ffcd04f87 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96475caac28419eb0b7dd78375e9e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5d24d2b8dc4844a48a76ed2ea2cffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:45.035538 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-e82e6549-bbfa-4e66-bcc6-362ffcd04f87 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] 10.222.0.20 "GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b" status: 200 len: 1260 microversion: 2.1 time: 0.197425 Aug 09 02:43:45.036109 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 199/413] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:44 2022] GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b => generated 1260 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:43:46.037915 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-a8f257a4-54a9-475d-b78c-f571a70c22bf tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:46.038594 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-a8f257a4-54a9-475d-b78c-f571a70c22bf tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] [instance: 7cfae5d5-8846-4c6d-8e56-5a52f817b48e] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:46.046587 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a8f257a4-54a9-475d-b78c-f571a70c22bf tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:46.047150 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a8f257a4-54a9-475d-b78c-f571a70c22bf tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:46.047652 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a8f257a4-54a9-475d-b78c-f571a70c22bf tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:46.048454 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a8f257a4-54a9-475d-b78c-f571a70c22bf tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:46.048984 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a8f257a4-54a9-475d-b78c-f571a70c22bf tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:46.049475 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a8f257a4-54a9-475d-b78c-f571a70c22bf tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:46.056870 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-d7fbb936-7df3-4d40-94a3-e82f9f6a8c08 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:46.057662 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-d7fbb936-7df3-4d40-94a3-e82f9f6a8c08 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] [instance: 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:46.065556 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d7fbb936-7df3-4d40-94a3-e82f9f6a8c08 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:46.066106 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d7fbb936-7df3-4d40-94a3-e82f9f6a8c08 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:46.066640 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d7fbb936-7df3-4d40-94a3-e82f9f6a8c08 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:46.067433 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d7fbb936-7df3-4d40-94a3-e82f9f6a8c08 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:46.067950 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d7fbb936-7df3-4d40-94a3-e82f9f6a8c08 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:46.068434 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d7fbb936-7df3-4d40-94a3-e82f9f6a8c08 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:46.262821 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-a8f257a4-54a9-475d-b78c-f571a70c22bf tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6b64eb434414ab61f19b170385c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5508bdf5e4577b49783c3e424f1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:46.266389 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-d7fbb936-7df3-4d40-94a3-e82f9f6a8c08 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96475caac28419eb0b7dd78375e9e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5d24d2b8dc4844a48a76ed2ea2cffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:46.271104 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-a8f257a4-54a9-475d-b78c-f571a70c22bf tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] 10.222.0.20 "GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e" status: 200 len: 1755 microversion: 2.1 time: 0.239886 Aug 09 02:43:46.271938 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 215/414] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:46 2022] GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e => generated 1755 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:43:46.274257 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-d7fbb936-7df3-4d40-94a3-e82f9f6a8c08 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] 10.222.0.20 "GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b" status: 200 len: 1260 microversion: 2.1 time: 0.221904 Aug 09 02:43:46.274838 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 200/415] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:46 2022] GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b => generated 1260 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:43:47.297013 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-805cf7d4-248b-4dc6-9211-71549d4a2273 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:47.297980 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-805cf7d4-248b-4dc6-9211-71549d4a2273 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] [instance: 7cfae5d5-8846-4c6d-8e56-5a52f817b48e] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:47.299180 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-1ecc4894-f48a-41d4-b1c9-cee18b26dd29 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:47.300190 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-1ecc4894-f48a-41d4-b1c9-cee18b26dd29 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] [instance: 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:47.307843 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-805cf7d4-248b-4dc6-9211-71549d4a2273 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:47.308244 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1ecc4894-f48a-41d4-b1c9-cee18b26dd29 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:47.308448 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-805cf7d4-248b-4dc6-9211-71549d4a2273 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:47.308730 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1ecc4894-f48a-41d4-b1c9-cee18b26dd29 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:47.309168 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1ecc4894-f48a-41d4-b1c9-cee18b26dd29 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:47.309321 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-805cf7d4-248b-4dc6-9211-71549d4a2273 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:47.309869 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1ecc4894-f48a-41d4-b1c9-cee18b26dd29 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:47.310380 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1ecc4894-f48a-41d4-b1c9-cee18b26dd29 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:47.310539 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-805cf7d4-248b-4dc6-9211-71549d4a2273 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:47.310781 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1ecc4894-f48a-41d4-b1c9-cee18b26dd29 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:47.311288 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-805cf7d4-248b-4dc6-9211-71549d4a2273 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:47.311847 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-805cf7d4-248b-4dc6-9211-71549d4a2273 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:47.512736 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-1ecc4894-f48a-41d4-b1c9-cee18b26dd29 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96475caac28419eb0b7dd78375e9e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5d24d2b8dc4844a48a76ed2ea2cffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:47.521024 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-1ecc4894-f48a-41d4-b1c9-cee18b26dd29 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] 10.222.0.20 "GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b" status: 200 len: 1260 microversion: 2.1 time: 0.228263 Aug 09 02:43:47.531936 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 201/416] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:47 2022] GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b => generated 1260 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:43:47.532356 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-805cf7d4-248b-4dc6-9211-71549d4a2273 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6b64eb434414ab61f19b170385c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5508bdf5e4577b49783c3e424f1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:47.539704 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-805cf7d4-248b-4dc6-9211-71549d4a2273 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] 10.222.0.20 "GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e" status: 200 len: 1755 microversion: 2.1 time: 0.249294 Aug 09 02:43:47.540279 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 216/417] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:47 2022] GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e => generated 1755 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:43:48.255452 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-b461d31b-6986-4da7-94eb-eae6825ef125 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:48.256244 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-b461d31b-6986-4da7-94eb-eae6825ef125 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:48.262913 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b461d31b-6986-4da7-94eb-eae6825ef125 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:48.263388 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b461d31b-6986-4da7-94eb-eae6825ef125 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:48.263809 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b461d31b-6986-4da7-94eb-eae6825ef125 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:48.264481 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b461d31b-6986-4da7-94eb-eae6825ef125 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:48.264920 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b461d31b-6986-4da7-94eb-eae6825ef125 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:48.265334 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b461d31b-6986-4da7-94eb-eae6825ef125 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:48.290507 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-b461d31b-6986-4da7-94eb-eae6825ef125 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73/ips" status: 200 len: 151 microversion: 2.20 time: 0.041569 Aug 09 02:43:48.291072 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 202/418] 10.222.0.20 () {60 vars in 1289 bytes} [Tue Aug 9 02:43:48 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73/ips => generated 151 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 02:43:48.543882 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-077c6551-51ca-46eb-ae3b-c8361c094100 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:48.544527 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-077c6551-51ca-46eb-ae3b-c8361c094100 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] [instance: 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:48.559916 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-077c6551-51ca-46eb-ae3b-c8361c094100 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:48.560522 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-077c6551-51ca-46eb-ae3b-c8361c094100 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:48.561143 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-077c6551-51ca-46eb-ae3b-c8361c094100 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:48.561609 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-077c6551-51ca-46eb-ae3b-c8361c094100 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:48.562397 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-077c6551-51ca-46eb-ae3b-c8361c094100 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:48.562586 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-e4ccddb7-1408-4130-9787-a0b67f4b66d4 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:48.563399 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-e4ccddb7-1408-4130-9787-a0b67f4b66d4 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] [instance: 7cfae5d5-8846-4c6d-8e56-5a52f817b48e] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:48.563746 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-077c6551-51ca-46eb-ae3b-c8361c094100 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:48.571799 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e4ccddb7-1408-4130-9787-a0b67f4b66d4 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:48.573256 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e4ccddb7-1408-4130-9787-a0b67f4b66d4 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:48.574647 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e4ccddb7-1408-4130-9787-a0b67f4b66d4 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:48.575441 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e4ccddb7-1408-4130-9787-a0b67f4b66d4 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:48.575905 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e4ccddb7-1408-4130-9787-a0b67f4b66d4 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:48.576384 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e4ccddb7-1408-4130-9787-a0b67f4b66d4 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:48.765521 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_cell0:SELECT=2 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:43:48.783956 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-077c6551-51ca-46eb-ae3b-c8361c094100 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96475caac28419eb0b7dd78375e9e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5d24d2b8dc4844a48a76ed2ea2cffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:48.786072 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_cell0:SELECT=6 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:43:48.792363 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-077c6551-51ca-46eb-ae3b-c8361c094100 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] 10.222.0.20 "GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b" status: 200 len: 1260 microversion: 2.1 time: 0.252486 Aug 09 02:43:48.792928 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 217/419] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:48 2022] GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b => generated 1260 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:43:48.802188 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-e4ccddb7-1408-4130-9787-a0b67f4b66d4 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6b64eb434414ab61f19b170385c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5508bdf5e4577b49783c3e424f1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:48.810487 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-e4ccddb7-1408-4130-9787-a0b67f4b66d4 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] 10.222.0.20 "GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e" status: 200 len: 1755 microversion: 2.1 time: 0.253215 Aug 09 02:43:48.811071 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 203/420] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:48 2022] GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e => generated 1755 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:43:49.817075 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-1a3b1fba-ce26-4b09-b0a6-1144bbb4aec6 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:49.818143 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-1a3b1fba-ce26-4b09-b0a6-1144bbb4aec6 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] [instance: 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:49.820346 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_cell0:SELECT=2 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:43:49.826247 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1a3b1fba-ce26-4b09-b0a6-1144bbb4aec6 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:49.826721 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1a3b1fba-ce26-4b09-b0a6-1144bbb4aec6 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:49.827148 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1a3b1fba-ce26-4b09-b0a6-1144bbb4aec6 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:49.827836 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1a3b1fba-ce26-4b09-b0a6-1144bbb4aec6 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:49.828285 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1a3b1fba-ce26-4b09-b0a6-1144bbb4aec6 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:49.828699 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1a3b1fba-ce26-4b09-b0a6-1144bbb4aec6 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:49.832412 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-cd43e5fe-11f6-4937-8dd8-d3022a9bf80a tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:49.833004 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-cd43e5fe-11f6-4937-8dd8-d3022a9bf80a tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] [instance: 7cfae5d5-8846-4c6d-8e56-5a52f817b48e] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:49.839532 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-cd43e5fe-11f6-4937-8dd8-d3022a9bf80a tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:49.840001 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-cd43e5fe-11f6-4937-8dd8-d3022a9bf80a tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:49.840412 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-cd43e5fe-11f6-4937-8dd8-d3022a9bf80a tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:49.841092 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-cd43e5fe-11f6-4937-8dd8-d3022a9bf80a tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:49.841535 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-cd43e5fe-11f6-4937-8dd8-d3022a9bf80a tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:49.841947 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-cd43e5fe-11f6-4937-8dd8-d3022a9bf80a tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:50.032293 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-1a3b1fba-ce26-4b09-b0a6-1144bbb4aec6 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96475caac28419eb0b7dd78375e9e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5d24d2b8dc4844a48a76ed2ea2cffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:50.040654 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-1a3b1fba-ce26-4b09-b0a6-1144bbb4aec6 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] 10.222.0.20 "GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b" status: 200 len: 1260 microversion: 2.1 time: 0.230016 Aug 09 02:43:50.041552 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 218/421] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:49 2022] GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b => generated 1260 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:43:50.043117 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-cd43e5fe-11f6-4937-8dd8-d3022a9bf80a tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6b64eb434414ab61f19b170385c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5508bdf5e4577b49783c3e424f1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:50.051170 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-cd43e5fe-11f6-4937-8dd8-d3022a9bf80a tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] 10.222.0.20 "GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e" status: 200 len: 1755 microversion: 2.1 time: 0.222668 Aug 09 02:43:50.051719 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 204/422] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:49 2022] GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e => generated 1755 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:43:50.657659 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-9a374099-cfc4-4323-80a3-9f43dfbf1868 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:43:50.658586 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-9a374099-cfc4-4323-80a3-9f43dfbf1868 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:50.661510 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_api:SELECT=42 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:43:50.667451 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9a374099-cfc4-4323-80a3-9f43dfbf1868 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:50.667932 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9a374099-cfc4-4323-80a3-9f43dfbf1868 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:50.668366 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9a374099-cfc4-4323-80a3-9f43dfbf1868 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:50.669056 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9a374099-cfc4-4323-80a3-9f43dfbf1868 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:50.669504 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9a374099-cfc4-4323-80a3-9f43dfbf1868 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:50.669929 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9a374099-cfc4-4323-80a3-9f43dfbf1868 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:50.692631 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.objects.instance [None req-9a374099-cfc4-4323-80a3-9f43dfbf1868 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lazy-loading 'flavor' on Instance uuid 9919dd32-c9e0-42ae-8981-414c2e663e73 {{(pid=124427) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 02:43:50.902359 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-9a374099-cfc4-4323-80a3-9f43dfbf1868 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "POST /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73/action" status: 202 len: 0 microversion: 2.20 time: 0.251179 Aug 09 02:43:50.906317 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 219/423] 10.222.0.20 () {62 vars in 1319 bytes} [Tue Aug 9 02:43:50 2022] POST /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 02:43:50.911724 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-203c830e-3a59-48ef-86a4-b7c0bc923008 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:50.912329 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-203c830e-3a59-48ef-86a4-b7c0bc923008 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:50.921140 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-203c830e-3a59-48ef-86a4-b7c0bc923008 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:50.921611 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-203c830e-3a59-48ef-86a4-b7c0bc923008 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:50.922429 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-203c830e-3a59-48ef-86a4-b7c0bc923008 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:50.923221 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-203c830e-3a59-48ef-86a4-b7c0bc923008 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:50.923736 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-203c830e-3a59-48ef-86a4-b7c0bc923008 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:50.924358 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-203c830e-3a59-48ef-86a4-b7c0bc923008 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:51.062188 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-203c830e-3a59-48ef-86a4-b7c0bc923008 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:51.062785 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-a15b3223-b28e-4fa3-9e64-5210f7f30ce1 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:51.063459 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-a15b3223-b28e-4fa3-9e64-5210f7f30ce1 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] [instance: 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:51.070711 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a15b3223-b28e-4fa3-9e64-5210f7f30ce1 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:51.071095 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-203c830e-3a59-48ef-86a4-b7c0bc923008 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:51.071255 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a15b3223-b28e-4fa3-9e64-5210f7f30ce1 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:51.071599 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a15b3223-b28e-4fa3-9e64-5210f7f30ce1 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:51.072281 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a15b3223-b28e-4fa3-9e64-5210f7f30ce1 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:51.072611 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-203c830e-3a59-48ef-86a4-b7c0bc923008 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:51.072720 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a15b3223-b28e-4fa3-9e64-5210f7f30ce1 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:51.073129 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a15b3223-b28e-4fa3-9e64-5210f7f30ce1 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:51.073782 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-203c830e-3a59-48ef-86a4-b7c0bc923008 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1724 microversion: 2.20 time: 0.166240 Aug 09 02:43:51.086453 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 205/424] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:43:50 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:43:51.086453 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-48a97390-8ac8-478f-8558-20d24b6c7a74 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:51.086453 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-48a97390-8ac8-478f-8558-20d24b6c7a74 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] [instance: 7cfae5d5-8846-4c6d-8e56-5a52f817b48e] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:51.086453 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-48a97390-8ac8-478f-8558-20d24b6c7a74 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:51.086881 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-48a97390-8ac8-478f-8558-20d24b6c7a74 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:51.086881 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-48a97390-8ac8-478f-8558-20d24b6c7a74 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:51.087062 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-48a97390-8ac8-478f-8558-20d24b6c7a74 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:51.091770 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-48a97390-8ac8-478f-8558-20d24b6c7a74 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:51.091770 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-48a97390-8ac8-478f-8558-20d24b6c7a74 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:51.263955 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-a15b3223-b28e-4fa3-9e64-5210f7f30ce1 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96475caac28419eb0b7dd78375e9e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5d24d2b8dc4844a48a76ed2ea2cffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:51.272627 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-a15b3223-b28e-4fa3-9e64-5210f7f30ce1 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] 10.222.0.20 "GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b" status: 200 len: 1260 microversion: 2.1 time: 0.214154 Aug 09 02:43:51.273189 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 220/425] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:51 2022] GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b => generated 1260 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:43:51.293047 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-48a97390-8ac8-478f-8558-20d24b6c7a74 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6b64eb434414ab61f19b170385c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5508bdf5e4577b49783c3e424f1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:51.305133 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-48a97390-8ac8-478f-8558-20d24b6c7a74 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] 10.222.0.20 "GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e" status: 200 len: 1755 microversion: 2.1 time: 0.229308 Aug 09 02:43:51.305880 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 206/426] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:51 2022] GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e => generated 1755 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:43:52.099914 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-bccee94c-1383-4076-8207-7e4009e01ebd tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:52.100483 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-bccee94c-1383-4076-8207-7e4009e01ebd tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:52.107805 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-bccee94c-1383-4076-8207-7e4009e01ebd tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:52.108284 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-bccee94c-1383-4076-8207-7e4009e01ebd tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:52.108711 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-bccee94c-1383-4076-8207-7e4009e01ebd tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:52.109397 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-bccee94c-1383-4076-8207-7e4009e01ebd tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:52.109842 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-bccee94c-1383-4076-8207-7e4009e01ebd tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:52.110327 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-bccee94c-1383-4076-8207-7e4009e01ebd tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:52.240028 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-bccee94c-1383-4076-8207-7e4009e01ebd tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:52.242459 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:43:52.249821 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-bccee94c-1383-4076-8207-7e4009e01ebd tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:52.251359 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-bccee94c-1383-4076-8207-7e4009e01ebd tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:52.252522 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-bccee94c-1383-4076-8207-7e4009e01ebd tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1724 microversion: 2.20 time: 0.156591 Aug 09 02:43:52.253084 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 221/427] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:43:52 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:43:52.292923 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-a5e17d11-85ad-4a70-b921-059315acf04d tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:52.293688 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-a5e17d11-85ad-4a70-b921-059315acf04d tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] [instance: 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:52.300337 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a5e17d11-85ad-4a70-b921-059315acf04d tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:52.300810 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a5e17d11-85ad-4a70-b921-059315acf04d tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:52.301260 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a5e17d11-85ad-4a70-b921-059315acf04d tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:52.301971 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a5e17d11-85ad-4a70-b921-059315acf04d tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:52.302445 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a5e17d11-85ad-4a70-b921-059315acf04d tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:52.302861 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a5e17d11-85ad-4a70-b921-059315acf04d tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:52.327410 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-e7601989-6ff3-4a3f-b408-8837f9c659bf tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:52.328019 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-e7601989-6ff3-4a3f-b408-8837f9c659bf tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] [instance: 7cfae5d5-8846-4c6d-8e56-5a52f817b48e] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:52.334884 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e7601989-6ff3-4a3f-b408-8837f9c659bf tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:52.335370 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e7601989-6ff3-4a3f-b408-8837f9c659bf tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:52.335801 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e7601989-6ff3-4a3f-b408-8837f9c659bf tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:52.336617 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e7601989-6ff3-4a3f-b408-8837f9c659bf tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:52.337070 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e7601989-6ff3-4a3f-b408-8837f9c659bf tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:52.337490 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e7601989-6ff3-4a3f-b408-8837f9c659bf tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:52.488989 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-a5e17d11-85ad-4a70-b921-059315acf04d tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96475caac28419eb0b7dd78375e9e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5d24d2b8dc4844a48a76ed2ea2cffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:52.496947 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-a5e17d11-85ad-4a70-b921-059315acf04d tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] 10.222.0.20 "GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b" status: 200 len: 1260 microversion: 2.1 time: 0.207842 Aug 09 02:43:52.497491 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 207/428] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:52 2022] GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b => generated 1260 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:43:52.531040 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-e7601989-6ff3-4a3f-b408-8837f9c659bf tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6b64eb434414ab61f19b170385c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5508bdf5e4577b49783c3e424f1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:52.539107 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-e7601989-6ff3-4a3f-b408-8837f9c659bf tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] 10.222.0.20 "GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e" status: 200 len: 1755 microversion: 2.1 time: 0.215851 Aug 09 02:43:52.539646 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 222/429] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:52 2022] GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e => generated 1755 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:43:53.103556 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [req-87777c54-6c2f-4b5a-901f-1ff9a89e096c req-09037a98-627e-4c1e-9dda-78c6ca9f6013 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b", "name": "network-vif-plugged", "status": "completed", "tag": "f12d9ad9-133b-4098-a94d-fd5f540a9f7c"}]} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:43:53.114855 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-87777c54-6c2f-4b5a-901f-1ff9a89e096c req-09037a98-627e-4c1e-9dda-78c6ca9f6013 service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:53.115301 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-87777c54-6c2f-4b5a-901f-1ff9a89e096c req-09037a98-627e-4c1e-9dda-78c6ca9f6013 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:53.115777 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-87777c54-6c2f-4b5a-901f-1ff9a89e096c req-09037a98-627e-4c1e-9dda-78c6ca9f6013 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:53.128046 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.compute.server_external_events [req-87777c54-6c2f-4b5a-901f-1ff9a89e096c req-09037a98-627e-4c1e-9dda-78c6ca9f6013 service nova] Creating event network-vif-plugged:f12d9ad9-133b-4098-a94d-fd5f540a9f7c for instance 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b on hv-cinder-85246 Aug 09 02:43:53.132959 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [req-87777c54-6c2f-4b5a-901f-1ff9a89e096c req-09037a98-627e-4c1e-9dda-78c6ca9f6013 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033720 Aug 09 02:43:53.133556 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 208/430] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:43:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:43:53.287170 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-1ad2800c-dea2-4d53-b6dd-f17b95bcabdb tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:53.288082 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-1ad2800c-dea2-4d53-b6dd-f17b95bcabdb tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:53.298990 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1ad2800c-dea2-4d53-b6dd-f17b95bcabdb tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:53.299836 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1ad2800c-dea2-4d53-b6dd-f17b95bcabdb tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:53.300561 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1ad2800c-dea2-4d53-b6dd-f17b95bcabdb tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:53.301699 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1ad2800c-dea2-4d53-b6dd-f17b95bcabdb tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:53.302506 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1ad2800c-dea2-4d53-b6dd-f17b95bcabdb tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:53.303225 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1ad2800c-dea2-4d53-b6dd-f17b95bcabdb tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:53.444466 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-1ad2800c-dea2-4d53-b6dd-f17b95bcabdb tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:53.452649 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-1ad2800c-dea2-4d53-b6dd-f17b95bcabdb tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:53.454133 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-1ad2800c-dea2-4d53-b6dd-f17b95bcabdb tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:53.455317 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-1ad2800c-dea2-4d53-b6dd-f17b95bcabdb tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1724 microversion: 2.20 time: 0.175099 Aug 09 02:43:53.455853 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 223/431] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:43:53 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:43:53.519856 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-00ef8220-5a55-47ca-9673-6e219e6c63d9 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:53.520666 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-00ef8220-5a55-47ca-9673-6e219e6c63d9 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] [instance: 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:53.527332 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-00ef8220-5a55-47ca-9673-6e219e6c63d9 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:53.527813 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-00ef8220-5a55-47ca-9673-6e219e6c63d9 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:53.528224 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-00ef8220-5a55-47ca-9673-6e219e6c63d9 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:53.528924 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-00ef8220-5a55-47ca-9673-6e219e6c63d9 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:53.529357 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-00ef8220-5a55-47ca-9673-6e219e6c63d9 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:53.529790 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-00ef8220-5a55-47ca-9673-6e219e6c63d9 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:53.559923 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-8db166d1-1d73-4e94-8e7d-82b4f3e3b438 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:53.560469 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-8db166d1-1d73-4e94-8e7d-82b4f3e3b438 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] [instance: 7cfae5d5-8846-4c6d-8e56-5a52f817b48e] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:53.566358 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8db166d1-1d73-4e94-8e7d-82b4f3e3b438 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:53.566831 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8db166d1-1d73-4e94-8e7d-82b4f3e3b438 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:53.567273 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8db166d1-1d73-4e94-8e7d-82b4f3e3b438 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:53.567964 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8db166d1-1d73-4e94-8e7d-82b4f3e3b438 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:53.568396 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8db166d1-1d73-4e94-8e7d-82b4f3e3b438 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:53.568810 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8db166d1-1d73-4e94-8e7d-82b4f3e3b438 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:53.963844 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-00ef8220-5a55-47ca-9673-6e219e6c63d9 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96475caac28419eb0b7dd78375e9e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5d24d2b8dc4844a48a76ed2ea2cffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:53.971825 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-00ef8220-5a55-47ca-9673-6e219e6c63d9 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] 10.222.0.20 "GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b" status: 200 len: 1260 microversion: 2.1 time: 0.456614 Aug 09 02:43:53.972392 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 209/432] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:53 2022] GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b => generated 1260 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:43:53.993162 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-8db166d1-1d73-4e94-8e7d-82b4f3e3b438 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6b64eb434414ab61f19b170385c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5508bdf5e4577b49783c3e424f1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:54.002088 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-8db166d1-1d73-4e94-8e7d-82b4f3e3b438 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] 10.222.0.20 "GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e" status: 200 len: 1755 microversion: 2.1 time: 0.446083 Aug 09 02:43:54.002703 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 224/433] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:53 2022] GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e => generated 1755 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:43:54.481405 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-294b8aaa-9347-4378-ab40-98467d20e0bf tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:54.482670 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-294b8aaa-9347-4378-ab40-98467d20e0bf tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:54.492104 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-294b8aaa-9347-4378-ab40-98467d20e0bf tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:54.492792 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-294b8aaa-9347-4378-ab40-98467d20e0bf tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:54.493384 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-294b8aaa-9347-4378-ab40-98467d20e0bf tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:54.495403 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-294b8aaa-9347-4378-ab40-98467d20e0bf tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:54.495857 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-294b8aaa-9347-4378-ab40-98467d20e0bf tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:54.496271 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-294b8aaa-9347-4378-ab40-98467d20e0bf tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:54.635776 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-294b8aaa-9347-4378-ab40-98467d20e0bf tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:54.643900 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-294b8aaa-9347-4378-ab40-98467d20e0bf tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:54.645390 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-294b8aaa-9347-4378-ab40-98467d20e0bf tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:54.646583 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-294b8aaa-9347-4378-ab40-98467d20e0bf tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1724 microversion: 2.20 time: 0.171535 Aug 09 02:43:54.647146 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 210/434] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:43:54 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:43:54.997514 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-bf11f1ac-cc2e-46ea-be75-43185a474226 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:54.998427 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-bf11f1ac-cc2e-46ea-be75-43185a474226 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] [instance: 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:55.009703 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-bf11f1ac-cc2e-46ea-be75-43185a474226 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:55.010791 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-bf11f1ac-cc2e-46ea-be75-43185a474226 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:55.011246 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-bf11f1ac-cc2e-46ea-be75-43185a474226 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:55.011914 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-bf11f1ac-cc2e-46ea-be75-43185a474226 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:55.012364 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-bf11f1ac-cc2e-46ea-be75-43185a474226 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:55.012815 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-bf11f1ac-cc2e-46ea-be75-43185a474226 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:55.026387 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-1c627d22-bf8f-482e-926c-bc307e9f3c39 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:55.027008 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-1c627d22-bf8f-482e-926c-bc307e9f3c39 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] [instance: 7cfae5d5-8846-4c6d-8e56-5a52f817b48e] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:55.034462 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1c627d22-bf8f-482e-926c-bc307e9f3c39 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:55.035158 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1c627d22-bf8f-482e-926c-bc307e9f3c39 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:55.035585 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1c627d22-bf8f-482e-926c-bc307e9f3c39 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:55.036462 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1c627d22-bf8f-482e-926c-bc307e9f3c39 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:55.036928 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1c627d22-bf8f-482e-926c-bc307e9f3c39 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:55.037342 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1c627d22-bf8f-482e-926c-bc307e9f3c39 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:55.220748 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-bf11f1ac-cc2e-46ea-be75-43185a474226 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96475caac28419eb0b7dd78375e9e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5d24d2b8dc4844a48a76ed2ea2cffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:55.228589 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-bf11f1ac-cc2e-46ea-be75-43185a474226 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] 10.222.0.20 "GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b" status: 200 len: 1260 microversion: 2.1 time: 0.237869 Aug 09 02:43:55.229171 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 225/435] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:54 2022] GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b => generated 1260 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:43:55.235803 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-1c627d22-bf8f-482e-926c-bc307e9f3c39 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6b64eb434414ab61f19b170385c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5508bdf5e4577b49783c3e424f1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:55.244328 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-1c627d22-bf8f-482e-926c-bc307e9f3c39 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] 10.222.0.20 "GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e" status: 200 len: 1755 microversion: 2.1 time: 0.222013 Aug 09 02:43:55.245052 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 211/436] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:55 2022] GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e => generated 1755 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:43:55.673738 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-df7a98f9-03e2-4fab-8287-66f21c35eba5 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:55.674694 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-df7a98f9-03e2-4fab-8287-66f21c35eba5 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:55.684607 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-df7a98f9-03e2-4fab-8287-66f21c35eba5 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:55.685384 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-df7a98f9-03e2-4fab-8287-66f21c35eba5 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:55.686137 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-df7a98f9-03e2-4fab-8287-66f21c35eba5 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:55.687263 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-df7a98f9-03e2-4fab-8287-66f21c35eba5 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:55.688001 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-df7a98f9-03e2-4fab-8287-66f21c35eba5 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:55.688747 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-df7a98f9-03e2-4fab-8287-66f21c35eba5 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:55.825690 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-df7a98f9-03e2-4fab-8287-66f21c35eba5 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:55.834258 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-df7a98f9-03e2-4fab-8287-66f21c35eba5 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:55.835735 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-df7a98f9-03e2-4fab-8287-66f21c35eba5 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:55.836856 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-df7a98f9-03e2-4fab-8287-66f21c35eba5 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1724 microversion: 2.20 time: 0.169891 Aug 09 02:43:55.837426 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 226/437] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:43:55 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:43:56.252039 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-89b77af4-682a-428f-8476-79ad0e351b68 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:56.252636 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-89b77af4-682a-428f-8476-79ad0e351b68 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] [instance: 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:56.259724 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-89b77af4-682a-428f-8476-79ad0e351b68 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:56.259870 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-89b77af4-682a-428f-8476-79ad0e351b68 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:56.260357 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-89b77af4-682a-428f-8476-79ad0e351b68 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:56.261035 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-89b77af4-682a-428f-8476-79ad0e351b68 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:56.261474 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-89b77af4-682a-428f-8476-79ad0e351b68 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:56.261847 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-89b77af4-682a-428f-8476-79ad0e351b68 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:56.265561 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-7632fc39-b2c2-483a-a143-e9f0b2680ec2 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:56.266742 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-7632fc39-b2c2-483a-a143-e9f0b2680ec2 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] [instance: 7cfae5d5-8846-4c6d-8e56-5a52f817b48e] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:56.274365 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7632fc39-b2c2-483a-a143-e9f0b2680ec2 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:56.275070 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7632fc39-b2c2-483a-a143-e9f0b2680ec2 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:56.275682 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7632fc39-b2c2-483a-a143-e9f0b2680ec2 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:56.276444 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7632fc39-b2c2-483a-a143-e9f0b2680ec2 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:56.276948 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7632fc39-b2c2-483a-a143-e9f0b2680ec2 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:56.277421 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7632fc39-b2c2-483a-a143-e9f0b2680ec2 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:56.461730 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-89b77af4-682a-428f-8476-79ad0e351b68 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96475caac28419eb0b7dd78375e9e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5d24d2b8dc4844a48a76ed2ea2cffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:56.469775 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-89b77af4-682a-428f-8476-79ad0e351b68 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] 10.222.0.20 "GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b" status: 200 len: 1443 microversion: 2.1 time: 0.222050 Aug 09 02:43:56.470643 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 212/438] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:56 2022] GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b => generated 1443 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:43:56.479746 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-7632fc39-b2c2-483a-a143-e9f0b2680ec2 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6b64eb434414ab61f19b170385c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5508bdf5e4577b49783c3e424f1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:56.488451 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-7632fc39-b2c2-483a-a143-e9f0b2680ec2 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] 10.222.0.20 "GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e" status: 200 len: 1755 microversion: 2.1 time: 0.226952 Aug 09 02:43:56.488995 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 227/439] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:56 2022] GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e => generated 1755 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:43:56.490913 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-730a8d26-f6df-4d21-a6c7-c7a6009ecd98 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:56.491517 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-730a8d26-f6df-4d21-a6c7-c7a6009ecd98 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] [instance: 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:56.497572 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-730a8d26-f6df-4d21-a6c7-c7a6009ecd98 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:56.498054 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-730a8d26-f6df-4d21-a6c7-c7a6009ecd98 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:56.498503 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-730a8d26-f6df-4d21-a6c7-c7a6009ecd98 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:56.499208 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-730a8d26-f6df-4d21-a6c7-c7a6009ecd98 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:56.499641 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-730a8d26-f6df-4d21-a6c7-c7a6009ecd98 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:56.500048 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-730a8d26-f6df-4d21-a6c7-c7a6009ecd98 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:56.636868 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-730a8d26-f6df-4d21-a6c7-c7a6009ecd98 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96475caac28419eb0b7dd78375e9e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5d24d2b8dc4844a48a76ed2ea2cffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:56.644775 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-730a8d26-f6df-4d21-a6c7-c7a6009ecd98 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] 10.222.0.20 "GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b" status: 200 len: 1443 microversion: 2.1 time: 0.157741 Aug 09 02:43:56.645344 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 213/440] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:56 2022] GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b => generated 1443 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:43:56.860033 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-8e311dd3-69e6-4221-9a74-3257d3f09ac3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:56.860748 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-8e311dd3-69e6-4221-9a74-3257d3f09ac3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:56.866891 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8e311dd3-69e6-4221-9a74-3257d3f09ac3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:56.867371 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8e311dd3-69e6-4221-9a74-3257d3f09ac3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:56.867783 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8e311dd3-69e6-4221-9a74-3257d3f09ac3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:56.868533 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8e311dd3-69e6-4221-9a74-3257d3f09ac3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:56.868960 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8e311dd3-69e6-4221-9a74-3257d3f09ac3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:56.869395 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8e311dd3-69e6-4221-9a74-3257d3f09ac3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:57.071842 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-8e311dd3-69e6-4221-9a74-3257d3f09ac3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:57.080509 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-8e311dd3-69e6-4221-9a74-3257d3f09ac3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:57.081987 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-8e311dd3-69e6-4221-9a74-3257d3f09ac3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:57.083175 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-8e311dd3-69e6-4221-9a74-3257d3f09ac3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1724 microversion: 2.20 time: 0.227574 Aug 09 02:43:57.084485 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 228/441] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:43:56 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1724 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:43:57.509026 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-2938539c-d49e-424c-8553-c05c448cd9bb tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:57.509651 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-2938539c-d49e-424c-8553-c05c448cd9bb tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] [instance: 7cfae5d5-8846-4c6d-8e56-5a52f817b48e] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:57.516320 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2938539c-d49e-424c-8553-c05c448cd9bb tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:57.516802 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2938539c-d49e-424c-8553-c05c448cd9bb tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:57.517208 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2938539c-d49e-424c-8553-c05c448cd9bb tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:57.517885 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2938539c-d49e-424c-8553-c05c448cd9bb tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:57.518367 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2938539c-d49e-424c-8553-c05c448cd9bb tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:57.518808 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2938539c-d49e-424c-8553-c05c448cd9bb tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:57.725349 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-2938539c-d49e-424c-8553-c05c448cd9bb tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6b64eb434414ab61f19b170385c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5508bdf5e4577b49783c3e424f1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:57.734394 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-2938539c-d49e-424c-8553-c05c448cd9bb tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] 10.222.0.20 "GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e" status: 200 len: 1755 microversion: 2.1 time: 0.229239 Aug 09 02:43:57.735182 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 214/442] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:57 2022] GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e => generated 1755 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:43:58.105332 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-63e7bb3b-01be-4e4a-bf14-b8553dbfd5fa tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:58.105899 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-63e7bb3b-01be-4e4a-bf14-b8553dbfd5fa tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:58.113148 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-63e7bb3b-01be-4e4a-bf14-b8553dbfd5fa tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:58.113626 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-63e7bb3b-01be-4e4a-bf14-b8553dbfd5fa tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:58.114036 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-63e7bb3b-01be-4e4a-bf14-b8553dbfd5fa tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:58.114757 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-63e7bb3b-01be-4e4a-bf14-b8553dbfd5fa tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:58.115200 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-63e7bb3b-01be-4e4a-bf14-b8553dbfd5fa tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:58.115618 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-63e7bb3b-01be-4e4a-bf14-b8553dbfd5fa tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:58.329582 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-63e7bb3b-01be-4e4a-bf14-b8553dbfd5fa tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:58.337923 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-63e7bb3b-01be-4e4a-bf14-b8553dbfd5fa tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:58.339572 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-63e7bb3b-01be-4e4a-bf14-b8553dbfd5fa tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:58.340789 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-63e7bb3b-01be-4e4a-bf14-b8553dbfd5fa tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1724 microversion: 2.20 time: 0.239522 Aug 09 02:43:58.341349 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 229/443] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:43:58 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1724 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:43:58.519869 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [req-671888ae-38dc-4bae-9021-1fa627b993f0 req-6f8132bd-9ff6-47b4-9131-40100d4ff606 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b", "tag": "f12d9ad9-133b-4098-a94d-fd5f540a9f7c"}]} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:43:58.529693 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-671888ae-38dc-4bae-9021-1fa627b993f0 req-6f8132bd-9ff6-47b4-9131-40100d4ff606 service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:58.530182 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-671888ae-38dc-4bae-9021-1fa627b993f0 req-6f8132bd-9ff6-47b4-9131-40100d4ff606 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:58.530600 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-671888ae-38dc-4bae-9021-1fa627b993f0 req-6f8132bd-9ff6-47b4-9131-40100d4ff606 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:58.534403 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_cell1:SELECT=100 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:43:58.542455 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.compute.server_external_events [req-671888ae-38dc-4bae-9021-1fa627b993f0 req-6f8132bd-9ff6-47b4-9131-40100d4ff606 service nova] Creating event network-changed:f12d9ad9-133b-4098-a94d-fd5f540a9f7c for instance 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b on hv-cinder-85246 Aug 09 02:43:58.547362 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [req-671888ae-38dc-4bae-9021-1fa627b993f0 req-6f8132bd-9ff6-47b4-9131-40100d4ff606 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031117 Aug 09 02:43:58.547922 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 215/444] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:43:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:43:58.756267 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-8deb3a33-ccad-4a4e-ab3c-13b902a8df43 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:58.757172 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-8deb3a33-ccad-4a4e-ab3c-13b902a8df43 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] [instance: 7cfae5d5-8846-4c6d-8e56-5a52f817b48e] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:58.763587 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8deb3a33-ccad-4a4e-ab3c-13b902a8df43 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:58.764072 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8deb3a33-ccad-4a4e-ab3c-13b902a8df43 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:58.764500 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8deb3a33-ccad-4a4e-ab3c-13b902a8df43 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:58.765226 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8deb3a33-ccad-4a4e-ab3c-13b902a8df43 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:58.765657 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8deb3a33-ccad-4a4e-ab3c-13b902a8df43 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:58.766318 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8deb3a33-ccad-4a4e-ab3c-13b902a8df43 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:59.014801 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-8deb3a33-ccad-4a4e-ab3c-13b902a8df43 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6b64eb434414ab61f19b170385c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5508bdf5e4577b49783c3e424f1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:59.023835 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-8deb3a33-ccad-4a4e-ab3c-13b902a8df43 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] 10.222.0.20 "GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e" status: 200 len: 1755 microversion: 2.1 time: 0.271353 Aug 09 02:43:59.024534 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 230/445] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:43:58 2022] GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e => generated 1755 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:43:59.368296 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-4c9bd74f-5dc7-44b1-8252-1a404a7ec6ca tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:43:59.369624 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-4c9bd74f-5dc7-44b1-8252-1a404a7ec6ca tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:43:59.378706 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4c9bd74f-5dc7-44b1-8252-1a404a7ec6ca tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:59.379283 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4c9bd74f-5dc7-44b1-8252-1a404a7ec6ca tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:59.379695 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4c9bd74f-5dc7-44b1-8252-1a404a7ec6ca tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:59.381441 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4c9bd74f-5dc7-44b1-8252-1a404a7ec6ca tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:43:59.383719 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4c9bd74f-5dc7-44b1-8252-1a404a7ec6ca tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:43:59.384295 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4c9bd74f-5dc7-44b1-8252-1a404a7ec6ca tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:43:59.537987 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-4c9bd74f-5dc7-44b1-8252-1a404a7ec6ca tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:59.548629 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-4c9bd74f-5dc7-44b1-8252-1a404a7ec6ca tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:59.550125 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-4c9bd74f-5dc7-44b1-8252-1a404a7ec6ca tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:43:59.551486 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-4c9bd74f-5dc7-44b1-8252-1a404a7ec6ca tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1724 microversion: 2.20 time: 0.191243 Aug 09 02:43:59.552058 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 216/446] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:43:59 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1724 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:44:00.045801 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-d5b1cce7-444d-4529-ba0c-45cbf0e4bd33 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:00.046408 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-d5b1cce7-444d-4529-ba0c-45cbf0e4bd33 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] [instance: 7cfae5d5-8846-4c6d-8e56-5a52f817b48e] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:00.053455 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d5b1cce7-444d-4529-ba0c-45cbf0e4bd33 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:00.053936 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d5b1cce7-444d-4529-ba0c-45cbf0e4bd33 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:00.054396 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d5b1cce7-444d-4529-ba0c-45cbf0e4bd33 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:00.055072 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d5b1cce7-444d-4529-ba0c-45cbf0e4bd33 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:00.055524 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d5b1cce7-444d-4529-ba0c-45cbf0e4bd33 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:00.055937 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d5b1cce7-444d-4529-ba0c-45cbf0e4bd33 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:00.196971 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-d5b1cce7-444d-4529-ba0c-45cbf0e4bd33 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6b64eb434414ab61f19b170385c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5508bdf5e4577b49783c3e424f1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:00.209373 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-d5b1cce7-444d-4529-ba0c-45cbf0e4bd33 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] 10.222.0.20 "GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e" status: 200 len: 1758 microversion: 2.1 time: 0.167583 Aug 09 02:44:00.212690 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 231/447] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:44:00 2022] GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e => generated 1758 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:44:00.579753 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-4289eb3f-e1b6-41f9-8fb8-d881e9e52662 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:00.580820 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-4289eb3f-e1b6-41f9-8fb8-d881e9e52662 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:00.590747 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4289eb3f-e1b6-41f9-8fb8-d881e9e52662 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:00.591229 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4289eb3f-e1b6-41f9-8fb8-d881e9e52662 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:00.591661 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4289eb3f-e1b6-41f9-8fb8-d881e9e52662 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:00.592362 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4289eb3f-e1b6-41f9-8fb8-d881e9e52662 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:00.592837 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4289eb3f-e1b6-41f9-8fb8-d881e9e52662 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:00.593259 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4289eb3f-e1b6-41f9-8fb8-d881e9e52662 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:00.727406 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-4289eb3f-e1b6-41f9-8fb8-d881e9e52662 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:00.736624 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-4289eb3f-e1b6-41f9-8fb8-d881e9e52662 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:00.738111 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-4289eb3f-e1b6-41f9-8fb8-d881e9e52662 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:00.739337 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-4289eb3f-e1b6-41f9-8fb8-d881e9e52662 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1724 microversion: 2.20 time: 0.166338 Aug 09 02:44:00.739903 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 217/448] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:44:00 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:44:00.989853 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-764c65f9-be18-4144-89a0-d751234dc7f7 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:00.990591 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-764c65f9-be18-4144-89a0-d751234dc7f7 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 86989fa1-a3d2-4af9-9e2c-319ac2a8a23c] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:01.000722 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-764c65f9-be18-4144-89a0-d751234dc7f7 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:01.001516 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-764c65f9-be18-4144-89a0-d751234dc7f7 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:01.002351 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-764c65f9-be18-4144-89a0-d751234dc7f7 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:01.003434 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-764c65f9-be18-4144-89a0-d751234dc7f7 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:01.004184 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-764c65f9-be18-4144-89a0-d751234dc7f7 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:01.004880 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-764c65f9-be18-4144-89a0-d751234dc7f7 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:01.030531 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-764c65f9-be18-4144-89a0-d751234dc7f7 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/86989fa1-a3d2-4af9-9e2c-319ac2a8a23c/ips" status: 200 len: 151 microversion: 2.1 time: 0.047747 Aug 09 02:44:01.031089 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 232/449] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Aug 9 02:44:00 2022] GET /compute/v2.1/servers/86989fa1-a3d2-4af9-9e2c-319ac2a8a23c/ips => generated 151 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:44:01.042730 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-c1b91bf3-c037-4604-a9cc-74f036e5f202 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b0e4e615-98a6-4e60-b4cb-b4a6ac5d9cfc"}} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:44:01.045152 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-c1b91bf3-c037-4604-a9cc-74f036e5f202 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 86989fa1-a3d2-4af9-9e2c-319ac2a8a23c] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:01.051434 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c1b91bf3-c037-4604-a9cc-74f036e5f202 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:01.051911 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c1b91bf3-c037-4604-a9cc-74f036e5f202 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:01.052340 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c1b91bf3-c037-4604-a9cc-74f036e5f202 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:01.053022 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c1b91bf3-c037-4604-a9cc-74f036e5f202 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:01.053466 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c1b91bf3-c037-4604-a9cc-74f036e5f202 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:01.053884 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c1b91bf3-c037-4604-a9cc-74f036e5f202 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:01.134303 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.wsgi [None req-c1b91bf3-c037-4604-a9cc-74f036e5f202 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] HTTP exception thrown: Invalid volume: volume b0e4e615-98a6-4e60-b4cb-b4a6ac5d9cfc is already attached to instances: e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a Aug 09 02:44:01.136076 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-c1b91bf3-c037-4604-a9cc-74f036e5f202 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Request method failure captured: Aug 09 02:44:01.136076 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: request: POST /compute/v2.1/servers/86989fa1-a3d2-4af9-9e2c-319ac2a8a23c/os-volume_attachments HTTP/1.1 Aug 09 02:44:01.136076 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Accept: application/json Aug 09 02:44:01.136076 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Accept-Encoding: identity Aug 09 02:44:01.136076 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Connection: close Aug 09 02:44:01.136076 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Content-Length: 74 Aug 09 02:44:01.136076 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Content-Type: application/json Aug 09 02:44:01.136076 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Host: 10.222.0.20 Aug 09 02:44:01.136076 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Openstack-System-Scope: None Aug 09 02:44:01.136076 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: User-Agent: python-urllib3/1.26.11 Aug 09 02:44:01.136076 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Auth-Token: gAAAAABi8ckjyQvMSPVjOXRhh70Rnc1ANMFv7G7JLArfSACfDLzvvcneDlsL-sI9hF681zwEIODxGFE7k1OsPJO-SGVxluvBNMmaFLG_fx-H9D1ZvGPLVeuDO_toy5qwJovkKz9pwj7m5cniNs8yMlVJKkLfQNx_gl4pQZFRtesItHh6k1DiYvw Aug 09 02:44:01.136076 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Domain-Id: None Aug 09 02:44:01.136076 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Domain-Name: None Aug 09 02:44:01.136076 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Identity-Status: Confirmed Aug 09 02:44:01.136076 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Is-Admin-Project: True Aug 09 02:44:01.136076 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Domain-Id: default Aug 09 02:44:01.136076 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Domain-Name: Default Aug 09 02:44:01.136076 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Id: 8ce26c854fc24cadb2be5ebd441b8f3a Aug 09 02:44:01.136076 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Name: tempest-AttachVolumeNegativeTest-1568455203 Aug 09 02:44:01.136076 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Role: reader,member Aug 09 02:44:01.136076 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Roles: reader,member Aug 09 02:44:01.137705 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8ce26c854fc24cadb2be5ebd441b8f3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8ce26c854fc24cadb2be5ebd441b8f3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8ce26c854fc24cadb2be5ebd441b8f3a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8ce26c854fc24cadb2be5ebd441b8f3a"}]}] Aug 09 02:44:01.137705 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant: tempest-AttachVolumeNegativeTest-1568455203 Aug 09 02:44:01.137705 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant-Id: 8ce26c854fc24cadb2be5ebd441b8f3a Aug 09 02:44:01.137705 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1568455203 Aug 09 02:44:01.137705 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User: tempest-AttachVolumeNegativeTest-1568455203-project Aug 09 02:44:01.137705 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Domain-Id: default Aug 09 02:44:01.137705 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Domain-Name: Default Aug 09 02:44:01.137705 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Id: 43232b9b191047f9a3e6ebab7ad36f02 Aug 09 02:44:01.137705 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Name: tempest-AttachVolumeNegativeTest-1568455203-project Aug 09 02:44:01.137705 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Aug 09 02:44:01.137705 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: {"volumeAttachment": {"volumeId": "b0e4e615-98a6-4e60-b4cb-b4a6ac5d9cfc"}} Aug 09 02:44:01.137705 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: method: > Aug 09 02:44:01.138651 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: exception: Invalid volume: volume b0e4e615-98a6-4e60-b4cb-b4a6ac5d9cfc is already attached to instances: e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a Aug 09 02:44:01.138651 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: action_args: {'server_id': '86989fa1-a3d2-4af9-9e2c-319ac2a8a23c', 'body': {'volumeAttachment': {'volumeId': 'b0e4e615-98a6-4e60-b4cb-b4a6ac5d9cfc'}}} Aug 09 02:44:01.138651 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 02:44:01.138651 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:44:01.138651 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 09 02:44:01.138651 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 09 02:44:01.138651 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 02:44:01.138651 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 02:44:01.138651 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 09 02:44:01.138651 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 09 02:44:01.138651 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 09 02:44:01.138651 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 09 02:44:01.138651 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 09 02:44:01.138651 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 09 02:44:01.138651 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b0e4e615-98a6-4e60-b4cb-b4a6ac5d9cfc is already attached to instances: e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a Aug 09 02:44:01.138651 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:44:01.138651 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:44:01.138651 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:44:01.138651 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:44:01.140056 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:44:01.140056 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:44:01.140056 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 02:44:01.140056 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 02:44:01.140056 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 02:44:01.140056 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 02:44:01.140056 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 02:44:01.140056 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 02:44:01.140056 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 02:44:01.140056 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 02:44:01.140056 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 02:44:01.140056 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 02:44:01.140056 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 09 02:44:01.140056 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 09 02:44:01.140056 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b0e4e615-98a6-4e60-b4cb-b4a6ac5d9cfc is already attached to instances: e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a Aug 09 02:44:01.140056 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:44:01.140056 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:44:01.140056 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:44:01.140056 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:44:01.140056 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:44:01.141485 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:44:01.141485 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 02:44:01.141485 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 02:44:01.141485 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b0e4e615-98a6-4e60-b4cb-b4a6ac5d9cfc is already attached to instances: e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a Aug 09 02:44:01.141485 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:44:01.141485 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-c1b91bf3-c037-4604-a9cc-74f036e5f202 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Returning 400 to user: Invalid volume: volume b0e4e615-98a6-4e60-b4cb-b4a6ac5d9cfc is already attached to instances: e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a {{(pid=124425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 02:44:01.141485 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-c1b91bf3-c037-4604-a9cc-74f036e5f202 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "POST /compute/v2.1/servers/86989fa1-a3d2-4af9-9e2c-319ac2a8a23c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098963 Aug 09 02:44:01.141485 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 218/450] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Aug 9 02:44:01 2022] POST /compute/v2.1/servers/86989fa1-a3d2-4af9-9e2c-319ac2a8a23c/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 02:44:01.146498 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-ff143944-425a-4231-9388-5a275d0614df tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:01.146996 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-ff143944-425a-4231-9388-5a275d0614df tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 86989fa1-a3d2-4af9-9e2c-319ac2a8a23c] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:01.153719 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ff143944-425a-4231-9388-5a275d0614df tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:01.154198 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ff143944-425a-4231-9388-5a275d0614df tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:01.154639 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ff143944-425a-4231-9388-5a275d0614df tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:01.155316 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ff143944-425a-4231-9388-5a275d0614df tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:01.155760 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ff143944-425a-4231-9388-5a275d0614df tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:01.156179 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ff143944-425a-4231-9388-5a275d0614df tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:01.180882 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-ff143944-425a-4231-9388-5a275d0614df tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 86989fa1-a3d2-4af9-9e2c-319ac2a8a23c] Going to try to terminate instance {{(pid=124427) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 02:44:01.258564 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-ff143944-425a-4231-9388-5a275d0614df tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "DELETE /compute/v2.1/servers/86989fa1-a3d2-4af9-9e2c-319ac2a8a23c" status: 204 len: 0 microversion: 2.1 time: 0.115485 Aug 09 02:44:01.259104 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 233/451] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 9 02:44:01 2022] DELETE /compute/v2.1/servers/86989fa1-a3d2-4af9-9e2c-319ac2a8a23c => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 02:44:01.267487 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-831e2c33-9f0f-436b-aa32-d9e83b952399 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:01.268106 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-831e2c33-9f0f-436b-aa32-d9e83b952399 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 86989fa1-a3d2-4af9-9e2c-319ac2a8a23c] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:01.274937 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-831e2c33-9f0f-436b-aa32-d9e83b952399 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:01.275438 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-831e2c33-9f0f-436b-aa32-d9e83b952399 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:01.275866 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-831e2c33-9f0f-436b-aa32-d9e83b952399 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:01.276641 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-831e2c33-9f0f-436b-aa32-d9e83b952399 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:01.277088 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-831e2c33-9f0f-436b-aa32-d9e83b952399 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:01.277530 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-831e2c33-9f0f-436b-aa32-d9e83b952399 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:01.409280 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-831e2c33-9f0f-436b-aa32-d9e83b952399 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:01.419925 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-831e2c33-9f0f-436b-aa32-d9e83b952399 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/86989fa1-a3d2-4af9-9e2c-319ac2a8a23c" status: 200 len: 1682 microversion: 2.1 time: 0.156051 Aug 09 02:44:01.420725 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 219/452] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:44:01 2022] GET /compute/v2.1/servers/86989fa1-a3d2-4af9-9e2c-319ac2a8a23c => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:44:01.765344 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-d911be0a-509a-476f-8581-24eb3999b795 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:01.766086 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-d911be0a-509a-476f-8581-24eb3999b795 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:01.772977 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d911be0a-509a-476f-8581-24eb3999b795 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:01.773482 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d911be0a-509a-476f-8581-24eb3999b795 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:01.773940 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d911be0a-509a-476f-8581-24eb3999b795 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:01.774699 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d911be0a-509a-476f-8581-24eb3999b795 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:01.775175 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d911be0a-509a-476f-8581-24eb3999b795 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:01.775617 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d911be0a-509a-476f-8581-24eb3999b795 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:01.911429 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-d911be0a-509a-476f-8581-24eb3999b795 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:01.920372 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-d911be0a-509a-476f-8581-24eb3999b795 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:01.921880 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-d911be0a-509a-476f-8581-24eb3999b795 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:01.923076 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-d911be0a-509a-476f-8581-24eb3999b795 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1724 microversion: 2.20 time: 0.162688 Aug 09 02:44:01.923646 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 234/453] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:44:01 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:44:02.446546 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-3adabecb-f736-439e-bad2-89fd34bc3c1b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:02.447196 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-3adabecb-f736-439e-bad2-89fd34bc3c1b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 86989fa1-a3d2-4af9-9e2c-319ac2a8a23c] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:02.449847 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:44:02.455444 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3adabecb-f736-439e-bad2-89fd34bc3c1b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:02.455922 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3adabecb-f736-439e-bad2-89fd34bc3c1b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:02.456348 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3adabecb-f736-439e-bad2-89fd34bc3c1b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:02.457030 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3adabecb-f736-439e-bad2-89fd34bc3c1b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:02.457471 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3adabecb-f736-439e-bad2-89fd34bc3c1b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:02.457885 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3adabecb-f736-439e-bad2-89fd34bc3c1b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:02.598271 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-3adabecb-f736-439e-bad2-89fd34bc3c1b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:02.606174 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-3adabecb-f736-439e-bad2-89fd34bc3c1b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/86989fa1-a3d2-4af9-9e2c-319ac2a8a23c" status: 200 len: 1682 microversion: 2.1 time: 0.163922 Aug 09 02:44:02.606766 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 220/454] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:44:02 2022] GET /compute/v2.1/servers/86989fa1-a3d2-4af9-9e2c-319ac2a8a23c => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:44:02.947078 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-7f58adf4-d27a-4bd1-8def-ef02d6c24fa4 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:02.947664 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-7f58adf4-d27a-4bd1-8def-ef02d6c24fa4 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:02.954584 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7f58adf4-d27a-4bd1-8def-ef02d6c24fa4 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:02.955072 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7f58adf4-d27a-4bd1-8def-ef02d6c24fa4 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:02.955509 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7f58adf4-d27a-4bd1-8def-ef02d6c24fa4 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:02.956201 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7f58adf4-d27a-4bd1-8def-ef02d6c24fa4 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:02.956653 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7f58adf4-d27a-4bd1-8def-ef02d6c24fa4 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:02.957075 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7f58adf4-d27a-4bd1-8def-ef02d6c24fa4 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:03.088748 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-7f58adf4-d27a-4bd1-8def-ef02d6c24fa4 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:03.096861 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-7f58adf4-d27a-4bd1-8def-ef02d6c24fa4 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:03.098371 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-7f58adf4-d27a-4bd1-8def-ef02d6c24fa4 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:03.099528 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-7f58adf4-d27a-4bd1-8def-ef02d6c24fa4 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1724 microversion: 2.20 time: 0.156445 Aug 09 02:44:03.100085 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 235/455] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:44:02 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:44:03.628670 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-6f3cd106-396f-4194-afbe-8317832b4c81 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:03.629341 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-6f3cd106-396f-4194-afbe-8317832b4c81 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 86989fa1-a3d2-4af9-9e2c-319ac2a8a23c] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:03.636360 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6f3cd106-396f-4194-afbe-8317832b4c81 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:03.636839 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6f3cd106-396f-4194-afbe-8317832b4c81 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:03.637262 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6f3cd106-396f-4194-afbe-8317832b4c81 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:03.637945 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6f3cd106-396f-4194-afbe-8317832b4c81 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:03.638420 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6f3cd106-396f-4194-afbe-8317832b4c81 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:03.638835 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6f3cd106-396f-4194-afbe-8317832b4c81 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:04.023040 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-6f3cd106-396f-4194-afbe-8317832b4c81 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:04.032073 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-6f3cd106-396f-4194-afbe-8317832b4c81 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/86989fa1-a3d2-4af9-9e2c-319ac2a8a23c" status: 200 len: 1682 microversion: 2.1 time: 0.407517 Aug 09 02:44:04.033027 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 221/456] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:44:03 2022] GET /compute/v2.1/servers/86989fa1-a3d2-4af9-9e2c-319ac2a8a23c => generated 1682 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:44:04.123149 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-d16a9fc0-af93-461a-8b0a-ef91700cda66 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:04.123728 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-d16a9fc0-af93-461a-8b0a-ef91700cda66 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:04.130578 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d16a9fc0-af93-461a-8b0a-ef91700cda66 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:04.131064 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d16a9fc0-af93-461a-8b0a-ef91700cda66 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:04.131481 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d16a9fc0-af93-461a-8b0a-ef91700cda66 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:04.132174 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d16a9fc0-af93-461a-8b0a-ef91700cda66 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:04.132639 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d16a9fc0-af93-461a-8b0a-ef91700cda66 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:04.133059 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d16a9fc0-af93-461a-8b0a-ef91700cda66 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:04.405173 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-d16a9fc0-af93-461a-8b0a-ef91700cda66 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:04.415708 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-d16a9fc0-af93-461a-8b0a-ef91700cda66 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:04.417178 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-d16a9fc0-af93-461a-8b0a-ef91700cda66 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:04.418595 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-d16a9fc0-af93-461a-8b0a-ef91700cda66 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1724 microversion: 2.20 time: 0.299408 Aug 09 02:44:04.430263 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 236/457] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:44:04 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1724 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:44:04.866418 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [req-fed44461-84cc-43f3-9206-6a0156554918 req-e96297a2-7f42-406c-8d0a-feda370a8484 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86989fa1-a3d2-4af9-9e2c-319ac2a8a23c", "name": "network-vif-deleted", "tag": "96884ef6-4436-4720-ad24-268bd22eb72d"}]} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:44:04.880275 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-fed44461-84cc-43f3-9206-6a0156554918 req-e96297a2-7f42-406c-8d0a-feda370a8484 service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:04.880744 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-fed44461-84cc-43f3-9206-6a0156554918 req-e96297a2-7f42-406c-8d0a-feda370a8484 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:04.881161 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-fed44461-84cc-43f3-9206-6a0156554918 req-e96297a2-7f42-406c-8d0a-feda370a8484 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:04.893451 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.compute.server_external_events [req-fed44461-84cc-43f3-9206-6a0156554918 req-e96297a2-7f42-406c-8d0a-feda370a8484 service nova] Creating event network-vif-deleted:96884ef6-4436-4720-ad24-268bd22eb72d for instance 86989fa1-a3d2-4af9-9e2c-319ac2a8a23c on hv-cinder-85246 Aug 09 02:44:04.899241 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [req-fed44461-84cc-43f3-9206-6a0156554918 req-e96297a2-7f42-406c-8d0a-feda370a8484 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037241 Aug 09 02:44:04.900532 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 222/458] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:44:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:44:05.056110 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-b1d5c9ba-1f46-40a8-a944-e0263dc21372 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:05.056988 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-b1d5c9ba-1f46-40a8-a944-e0263dc21372 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 86989fa1-a3d2-4af9-9e2c-319ac2a8a23c] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:05.063437 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b1d5c9ba-1f46-40a8-a944-e0263dc21372 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:05.064203 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b1d5c9ba-1f46-40a8-a944-e0263dc21372 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:05.064734 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b1d5c9ba-1f46-40a8-a944-e0263dc21372 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:05.065531 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b1d5c9ba-1f46-40a8-a944-e0263dc21372 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:05.066097 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b1d5c9ba-1f46-40a8-a944-e0263dc21372 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:05.066591 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b1d5c9ba-1f46-40a8-a944-e0263dc21372 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:05.071145 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:44:05.104744 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b1d5c9ba-1f46-40a8-a944-e0263dc21372 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:05.105230 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b1d5c9ba-1f46-40a8-a944-e0263dc21372 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:05.105662 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b1d5c9ba-1f46-40a8-a944-e0263dc21372 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:05.106110 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.objects.instance [None req-b1d5c9ba-1f46-40a8-a944-e0263dc21372 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lazy-loading 'fault' on Instance uuid 86989fa1-a3d2-4af9-9e2c-319ac2a8a23c {{(pid=124427) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 02:44:05.147564 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-b1d5c9ba-1f46-40a8-a944-e0263dc21372 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:05.155323 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-b1d5c9ba-1f46-40a8-a944-e0263dc21372 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/86989fa1-a3d2-4af9-9e2c-319ac2a8a23c" status: 200 len: 1331 microversion: 2.1 time: 0.103196 Aug 09 02:44:05.156113 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 237/459] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:44:05 2022] GET /compute/v2.1/servers/86989fa1-a3d2-4af9-9e2c-319ac2a8a23c => generated 1331 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:44:05.448153 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-3f342ad0-e7b9-4782-89fc-eb32045911fb tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:05.449176 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-3f342ad0-e7b9-4782-89fc-eb32045911fb tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:05.456231 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3f342ad0-e7b9-4782-89fc-eb32045911fb tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:05.457108 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3f342ad0-e7b9-4782-89fc-eb32045911fb tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:05.457805 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3f342ad0-e7b9-4782-89fc-eb32045911fb tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:05.458623 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3f342ad0-e7b9-4782-89fc-eb32045911fb tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:05.459388 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3f342ad0-e7b9-4782-89fc-eb32045911fb tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:05.459567 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3f342ad0-e7b9-4782-89fc-eb32045911fb tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:05.616060 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-3f342ad0-e7b9-4782-89fc-eb32045911fb tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:05.626034 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-3f342ad0-e7b9-4782-89fc-eb32045911fb tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:05.627605 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-3f342ad0-e7b9-4782-89fc-eb32045911fb tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:05.629308 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-3f342ad0-e7b9-4782-89fc-eb32045911fb tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1724 microversion: 2.20 time: 0.185768 Aug 09 02:44:05.642716 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 223/460] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:44:05 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1724 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:44:06.177119 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-553623d6-32f3-407a-a4a0-3a0b2b45aa40 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:06.177871 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-553623d6-32f3-407a-a4a0-3a0b2b45aa40 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 86989fa1-a3d2-4af9-9e2c-319ac2a8a23c] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:06.184998 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-553623d6-32f3-407a-a4a0-3a0b2b45aa40 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:06.185497 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-553623d6-32f3-407a-a4a0-3a0b2b45aa40 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:06.185935 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-553623d6-32f3-407a-a4a0-3a0b2b45aa40 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:06.186674 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-553623d6-32f3-407a-a4a0-3a0b2b45aa40 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:06.187127 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-553623d6-32f3-407a-a4a0-3a0b2b45aa40 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:06.187553 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-553623d6-32f3-407a-a4a0-3a0b2b45aa40 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:06.202758 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.wsgi [None req-553623d6-32f3-407a-a4a0-3a0b2b45aa40 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] HTTP exception thrown: Instance 86989fa1-a3d2-4af9-9e2c-319ac2a8a23c could not be found. Aug 09 02:44:06.204452 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-553623d6-32f3-407a-a4a0-3a0b2b45aa40 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Request method failure captured: Aug 09 02:44:06.204452 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: request: GET /compute/v2.1/servers/86989fa1-a3d2-4af9-9e2c-319ac2a8a23c HTTP/1.1 Aug 09 02:44:06.204452 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Accept: application/json Aug 09 02:44:06.204452 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Accept-Encoding: identity Aug 09 02:44:06.204452 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Connection: close Aug 09 02:44:06.204452 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Content-Length: 0 Aug 09 02:44:06.204452 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Content-Type: application/json Aug 09 02:44:06.204452 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Host: 10.222.0.20 Aug 09 02:44:06.204452 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Openstack-System-Scope: None Aug 09 02:44:06.204452 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: User-Agent: python-urllib3/1.26.11 Aug 09 02:44:06.204452 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Auth-Token: gAAAAABi8ckjyQvMSPVjOXRhh70Rnc1ANMFv7G7JLArfSACfDLzvvcneDlsL-sI9hF681zwEIODxGFE7k1OsPJO-SGVxluvBNMmaFLG_fx-H9D1ZvGPLVeuDO_toy5qwJovkKz9pwj7m5cniNs8yMlVJKkLfQNx_gl4pQZFRtesItHh6k1DiYvw Aug 09 02:44:06.204452 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Domain-Id: None Aug 09 02:44:06.204452 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Domain-Name: None Aug 09 02:44:06.204452 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Identity-Status: Confirmed Aug 09 02:44:06.204452 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Is-Admin-Project: True Aug 09 02:44:06.204452 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Domain-Id: default Aug 09 02:44:06.204452 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Domain-Name: Default Aug 09 02:44:06.204452 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Id: 8ce26c854fc24cadb2be5ebd441b8f3a Aug 09 02:44:06.204452 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Name: tempest-AttachVolumeNegativeTest-1568455203 Aug 09 02:44:06.204452 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Role: reader,member Aug 09 02:44:06.204452 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Roles: reader,member Aug 09 02:44:06.206031 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8ce26c854fc24cadb2be5ebd441b8f3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8ce26c854fc24cadb2be5ebd441b8f3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8ce26c854fc24cadb2be5ebd441b8f3a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8ce26c854fc24cadb2be5ebd441b8f3a"}]}] Aug 09 02:44:06.206031 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant: tempest-AttachVolumeNegativeTest-1568455203 Aug 09 02:44:06.206031 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant-Id: 8ce26c854fc24cadb2be5ebd441b8f3a Aug 09 02:44:06.206031 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1568455203 Aug 09 02:44:06.206031 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User: tempest-AttachVolumeNegativeTest-1568455203-project Aug 09 02:44:06.206031 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Domain-Id: default Aug 09 02:44:06.206031 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Domain-Name: Default Aug 09 02:44:06.206031 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Id: 43232b9b191047f9a3e6ebab7ad36f02 Aug 09 02:44:06.206031 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Name: tempest-AttachVolumeNegativeTest-1568455203-project Aug 09 02:44:06.206031 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: method: > Aug 09 02:44:06.206031 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: exception: Instance 86989fa1-a3d2-4af9-9e2c-319ac2a8a23c could not be found. Aug 09 02:44:06.206031 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: action_args: {'id': '86989fa1-a3d2-4af9-9e2c-319ac2a8a23c'} Aug 09 02:44:06.206938 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 02:44:06.206938 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:44:06.206938 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 02:44:06.206938 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 02:44:06.206938 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 02:44:06.206938 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 02:44:06.206938 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 02:44:06.206938 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 02:44:06.206938 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 02:44:06.206938 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 02:44:06.206938 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86989fa1-a3d2-4af9-9e2c-319ac2a8a23c could not be found. Aug 09 02:44:06.206938 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:44:06.206938 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:44:06.206938 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:44:06.206938 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:44:06.206938 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:44:06.206938 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:44:06.206938 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 02:44:06.206938 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 02:44:06.206938 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 02:44:06.208318 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 02:44:06.208318 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 02:44:06.208318 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 02:44:06.208318 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 02:44:06.208318 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 02:44:06.208318 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 02:44:06.208318 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 02:44:06.208318 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86989fa1-a3d2-4af9-9e2c-319ac2a8a23c could not be found. Aug 09 02:44:06.208318 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:44:06.208318 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:44:06.208318 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:44:06.208318 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:44:06.208318 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:44:06.208318 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:44:06.208318 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 02:44:06.208318 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 02:44:06.208318 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86989fa1-a3d2-4af9-9e2c-319ac2a8a23c could not be found. Aug 09 02:44:06.208318 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:44:06.209584 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-553623d6-32f3-407a-a4a0-3a0b2b45aa40 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Returning 404 to user: Instance 86989fa1-a3d2-4af9-9e2c-319ac2a8a23c could not be found. {{(pid=124427) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 02:44:06.209584 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-553623d6-32f3-407a-a4a0-3a0b2b45aa40 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/86989fa1-a3d2-4af9-9e2c-319ac2a8a23c" status: 404 len: 111 microversion: 2.1 time: 0.032717 Aug 09 02:44:06.210212 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 238/461] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:44:06 2022] GET /compute/v2.1/servers/86989fa1-a3d2-4af9-9e2c-319ac2a8a23c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 02:44:06.215368 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-5d45697f-8c84-4134-bc3c-fc8cc1cbf535 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '.version_select at 0x7fb0a05d61f0>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:06.239887 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-5d45697f-8c84-4134-bc3c-fc8cc1cbf535 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-330028877" status: 202 len: 0 microversion: 2.1 time: 0.028339 Aug 09 02:44:06.241088 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 224/462] 10.222.0.20 () {58 vars in 1218 bytes} [Tue Aug 9 02:44:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-330028877 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 02:44:06.653315 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-1c978d09-4b31-4bd0-bacc-fbc1e8096458 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:06.654020 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-1c978d09-4b31-4bd0-bacc-fbc1e8096458 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:06.660327 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1c978d09-4b31-4bd0-bacc-fbc1e8096458 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:06.660798 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1c978d09-4b31-4bd0-bacc-fbc1e8096458 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:06.661219 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1c978d09-4b31-4bd0-bacc-fbc1e8096458 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:06.661891 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1c978d09-4b31-4bd0-bacc-fbc1e8096458 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:06.662366 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1c978d09-4b31-4bd0-bacc-fbc1e8096458 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:06.662773 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1c978d09-4b31-4bd0-bacc-fbc1e8096458 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:06.847322 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-1c978d09-4b31-4bd0-bacc-fbc1e8096458 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:06.856094 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-1c978d09-4b31-4bd0-bacc-fbc1e8096458 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:06.857942 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-1c978d09-4b31-4bd0-bacc-fbc1e8096458 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:06.859287 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-1c978d09-4b31-4bd0-bacc-fbc1e8096458 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1724 microversion: 2.20 time: 0.210094 Aug 09 02:44:06.860402 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 239/463] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:44:06 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1724 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:44:07.005754 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-abf88a58-e69a-4975-ba81-e1c48082be78 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:07.006269 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-abf88a58-e69a-4975-ba81-e1c48082be78 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:07.012353 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-abf88a58-e69a-4975-ba81-e1c48082be78 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:07.012825 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-abf88a58-e69a-4975-ba81-e1c48082be78 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:07.013252 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-abf88a58-e69a-4975-ba81-e1c48082be78 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:07.013924 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-abf88a58-e69a-4975-ba81-e1c48082be78 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:07.014398 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-abf88a58-e69a-4975-ba81-e1c48082be78 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:07.014807 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-abf88a58-e69a-4975-ba81-e1c48082be78 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:07.055157 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-f4d4e255-4993-492b-95a8-92314386d943 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:07.055667 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-f4d4e255-4993-492b-95a8-92314386d943 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:07.061696 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-f4d4e255-4993-492b-95a8-92314386d943 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:07.062192 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-f4d4e255-4993-492b-95a8-92314386d943 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:07.062658 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-f4d4e255-4993-492b-95a8-92314386d943 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:07.063321 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-f4d4e255-4993-492b-95a8-92314386d943 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:07.063761 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-f4d4e255-4993-492b-95a8-92314386d943 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:07.064171 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-f4d4e255-4993-492b-95a8-92314386d943 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:07.137026 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.objects.instance [None req-abf88a58-e69a-4975-ba81-e1c48082be78 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lazy-loading 'services' on Instance uuid e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a {{(pid=124425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 02:44:07.185390 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.objects.instance [None req-f4d4e255-4993-492b-95a8-92314386d943 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lazy-loading 'services' on Instance uuid 8f16a110-9dc8-4e95-b6de-c30feee35b89 {{(pid=124427) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 02:44:07.252059 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-abf88a58-e69a-4975-ba81-e1c48082be78 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a/os-volume_attachments/b0e4e615-98a6-4e60-b4cb-b4a6ac5d9cfc" status: 202 len: 0 microversion: 2.1 time: 0.250195 Aug 09 02:44:07.252731 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 225/464] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Aug 9 02:44:07 2022] DELETE /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a/os-volume_attachments/b0e4e615-98a6-4e60-b4cb-b4a6ac5d9cfc => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 02:44:07.263206 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-a81f88ed-c5d4-4af9-9a96-bb99a75cb35e tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:07.266123 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-a81f88ed-c5d4-4af9-9a96-bb99a75cb35e tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:07.275122 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a81f88ed-c5d4-4af9-9a96-bb99a75cb35e tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:07.275801 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a81f88ed-c5d4-4af9-9a96-bb99a75cb35e tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:07.276507 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a81f88ed-c5d4-4af9-9a96-bb99a75cb35e tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:07.277296 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a81f88ed-c5d4-4af9-9a96-bb99a75cb35e tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:07.277800 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a81f88ed-c5d4-4af9-9a96-bb99a75cb35e tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:07.278578 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a81f88ed-c5d4-4af9-9a96-bb99a75cb35e tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:07.312324 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-a81f88ed-c5d4-4af9-9a96-bb99a75cb35e tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053547 Aug 09 02:44:07.313281 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 226/465] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 9 02:44:07 2022] GET /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 02:44:07.313572 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-f4d4e255-4993-492b-95a8-92314386d943 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89/os-volume_attachments/12777bd2-4a05-4fb8-9bab-c2992be73535" status: 202 len: 0 microversion: 2.1 time: 0.261084 Aug 09 02:44:07.317430 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 240/466] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Aug 9 02:44:07 2022] DELETE /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89/os-volume_attachments/12777bd2-4a05-4fb8-9bab-c2992be73535 => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 02:44:07.882682 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-72d262e3-7f71-4f3f-a6e4-dbc3a0fd7abc tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:07.883295 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-72d262e3-7f71-4f3f-a6e4-dbc3a0fd7abc tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:07.889755 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-72d262e3-7f71-4f3f-a6e4-dbc3a0fd7abc tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:07.890257 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-72d262e3-7f71-4f3f-a6e4-dbc3a0fd7abc tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:07.890680 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-72d262e3-7f71-4f3f-a6e4-dbc3a0fd7abc tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:07.891385 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-72d262e3-7f71-4f3f-a6e4-dbc3a0fd7abc tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:07.891828 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-72d262e3-7f71-4f3f-a6e4-dbc3a0fd7abc tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:07.892239 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-72d262e3-7f71-4f3f-a6e4-dbc3a0fd7abc tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:08.029034 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-72d262e3-7f71-4f3f-a6e4-dbc3a0fd7abc tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:08.037619 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-72d262e3-7f71-4f3f-a6e4-dbc3a0fd7abc tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:08.039230 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-72d262e3-7f71-4f3f-a6e4-dbc3a0fd7abc tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:08.040398 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-72d262e3-7f71-4f3f-a6e4-dbc3a0fd7abc tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1724 microversion: 2.20 time: 0.161830 Aug 09 02:44:08.040951 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 227/467] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:44:07 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:44:08.326496 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-fb54139b-84ab-4b69-a49c-69972672008d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:08.328916 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-fb54139b-84ab-4b69-a49c-69972672008d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:08.335655 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-fb54139b-84ab-4b69-a49c-69972672008d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:08.336158 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-fb54139b-84ab-4b69-a49c-69972672008d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:08.336586 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-fb54139b-84ab-4b69-a49c-69972672008d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:08.337282 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-fb54139b-84ab-4b69-a49c-69972672008d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:08.337729 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-fb54139b-84ab-4b69-a49c-69972672008d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:08.338179 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-fb54139b-84ab-4b69-a49c-69972672008d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:08.370822 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-fb54139b-84ab-4b69-a49c-69972672008d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049340 Aug 09 02:44:08.371371 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 241/468] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 9 02:44:08 2022] GET /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:44:09.068300 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-0b627a36-9379-4bd4-ada9-6a71f27a86ac tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:09.069262 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-0b627a36-9379-4bd4-ada9-6a71f27a86ac tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:09.078521 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0b627a36-9379-4bd4-ada9-6a71f27a86ac tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:09.078996 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0b627a36-9379-4bd4-ada9-6a71f27a86ac tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:09.079418 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0b627a36-9379-4bd4-ada9-6a71f27a86ac tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:09.080093 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0b627a36-9379-4bd4-ada9-6a71f27a86ac tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:09.080556 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0b627a36-9379-4bd4-ada9-6a71f27a86ac tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:09.080945 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0b627a36-9379-4bd4-ada9-6a71f27a86ac tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:09.215065 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-0b627a36-9379-4bd4-ada9-6a71f27a86ac tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:09.223310 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-0b627a36-9379-4bd4-ada9-6a71f27a86ac tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:09.224807 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-0b627a36-9379-4bd4-ada9-6a71f27a86ac tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:09.226000 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-0b627a36-9379-4bd4-ada9-6a71f27a86ac tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1724 microversion: 2.20 time: 0.164342 Aug 09 02:44:09.226593 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 228/469] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:44:09 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:44:09.382602 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-529fc71a-bb20-42fd-a1fa-46989697bb07 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:09.384762 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-529fc71a-bb20-42fd-a1fa-46989697bb07 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:09.391411 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-529fc71a-bb20-42fd-a1fa-46989697bb07 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:09.391884 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-529fc71a-bb20-42fd-a1fa-46989697bb07 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:09.392307 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-529fc71a-bb20-42fd-a1fa-46989697bb07 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:09.392970 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-529fc71a-bb20-42fd-a1fa-46989697bb07 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:09.393433 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-529fc71a-bb20-42fd-a1fa-46989697bb07 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:09.393820 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-529fc71a-bb20-42fd-a1fa-46989697bb07 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:09.425642 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-529fc71a-bb20-42fd-a1fa-46989697bb07 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046949 Aug 09 02:44:09.426215 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 242/470] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 9 02:44:09 2022] GET /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 02:44:09.490657 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-b4ddc646-d256-4231-9772-b0347e38501a tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:09.491233 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-b4ddc646-d256-4231-9772-b0347e38501a tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:09.497693 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b4ddc646-d256-4231-9772-b0347e38501a tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:09.498185 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b4ddc646-d256-4231-9772-b0347e38501a tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:09.498616 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b4ddc646-d256-4231-9772-b0347e38501a tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:09.499312 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b4ddc646-d256-4231-9772-b0347e38501a tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:09.499749 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b4ddc646-d256-4231-9772-b0347e38501a tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:09.500337 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b4ddc646-d256-4231-9772-b0347e38501a tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:09.524774 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-b4ddc646-d256-4231-9772-b0347e38501a tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a] Going to try to terminate instance {{(pid=124425) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 02:44:09.616548 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-b4ddc646-d256-4231-9772-b0347e38501a tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a" status: 204 len: 0 microversion: 2.1 time: 0.129337 Aug 09 02:44:09.617181 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 229/471] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 9 02:44:09 2022] DELETE /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 02:44:09.625627 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-252aba10-6411-45bc-b4e9-0bf3682bd1d0 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:09.626269 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-252aba10-6411-45bc-b4e9-0bf3682bd1d0 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:09.632322 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-252aba10-6411-45bc-b4e9-0bf3682bd1d0 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:09.633330 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-252aba10-6411-45bc-b4e9-0bf3682bd1d0 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:09.633732 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-252aba10-6411-45bc-b4e9-0bf3682bd1d0 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:09.634454 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-252aba10-6411-45bc-b4e9-0bf3682bd1d0 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:09.634909 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-252aba10-6411-45bc-b4e9-0bf3682bd1d0 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:09.635333 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-252aba10-6411-45bc-b4e9-0bf3682bd1d0 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:09.774195 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-252aba10-6411-45bc-b4e9-0bf3682bd1d0 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:09.785353 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-252aba10-6411-45bc-b4e9-0bf3682bd1d0 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a" status: 200 len: 1682 microversion: 2.1 time: 0.163399 Aug 09 02:44:09.786193 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 243/472] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:44:09 2022] GET /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:44:10.253371 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-6013b24e-8cdf-4718-a79b-9bc4d3c10625 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:10.254123 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-6013b24e-8cdf-4718-a79b-9bc4d3c10625 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:10.261617 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6013b24e-8cdf-4718-a79b-9bc4d3c10625 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:10.262144 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6013b24e-8cdf-4718-a79b-9bc4d3c10625 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:10.262648 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6013b24e-8cdf-4718-a79b-9bc4d3c10625 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:10.263408 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6013b24e-8cdf-4718-a79b-9bc4d3c10625 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:10.263900 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6013b24e-8cdf-4718-a79b-9bc4d3c10625 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:10.264357 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6013b24e-8cdf-4718-a79b-9bc4d3c10625 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:10.401179 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-6013b24e-8cdf-4718-a79b-9bc4d3c10625 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:10.409444 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-6013b24e-8cdf-4718-a79b-9bc4d3c10625 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:10.410926 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-6013b24e-8cdf-4718-a79b-9bc4d3c10625 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:10.412119 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-6013b24e-8cdf-4718-a79b-9bc4d3c10625 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1724 microversion: 2.20 time: 0.163855 Aug 09 02:44:10.412685 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 230/473] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:44:10 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:44:10.608526 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-bfa27e92-79cb-4c03-b5a6-1228fb7badf2 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:44:10.615408 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-bfa27e92-79cb-4c03-b5a6-1228fb7badf2 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:10.615893 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-bfa27e92-79cb-4c03-b5a6-1228fb7badf2 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:10.616327 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-bfa27e92-79cb-4c03-b5a6-1228fb7badf2 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:10.638952 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-bfa27e92-79cb-4c03-b5a6-1228fb7badf2 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Going to try to stop instance {{(pid=124427) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 09 02:44:10.692923 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-bfa27e92-79cb-4c03-b5a6-1228fb7badf2 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "POST /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89/action" status: 202 len: 0 microversion: 2.1 time: 0.090053 Aug 09 02:44:10.693757 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 244/474] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Aug 9 02:44:10 2022] POST /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 02:44:10.703512 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-6666108d-db6f-4c85-acb2-e0fe242c4515 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:10.704155 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-6666108d-db6f-4c85-acb2-e0fe242c4515 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:10.710293 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6666108d-db6f-4c85-acb2-e0fe242c4515 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:10.710766 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6666108d-db6f-4c85-acb2-e0fe242c4515 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:10.711192 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6666108d-db6f-4c85-acb2-e0fe242c4515 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:10.711885 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6666108d-db6f-4c85-acb2-e0fe242c4515 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:10.712307 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6666108d-db6f-4c85-acb2-e0fe242c4515 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:10.712717 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6666108d-db6f-4c85-acb2-e0fe242c4515 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:10.807623 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-ff15a8ab-df15-48eb-9dc9-a4874c4a2261 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:10.808315 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-ff15a8ab-df15-48eb-9dc9-a4874c4a2261 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:10.815065 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ff15a8ab-df15-48eb-9dc9-a4874c4a2261 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:10.819993 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ff15a8ab-df15-48eb-9dc9-a4874c4a2261 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:10.820440 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ff15a8ab-df15-48eb-9dc9-a4874c4a2261 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:10.821204 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ff15a8ab-df15-48eb-9dc9-a4874c4a2261 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:10.821664 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ff15a8ab-df15-48eb-9dc9-a4874c4a2261 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:10.822094 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ff15a8ab-df15-48eb-9dc9-a4874c4a2261 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:10.854932 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-6666108d-db6f-4c85-acb2-e0fe242c4515 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:10.857401 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:44:10.864962 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-6666108d-db6f-4c85-acb2-e0fe242c4515 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 200 len: 1722 microversion: 2.1 time: 0.166540 Aug 09 02:44:10.865575 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 231/475] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:44:10 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:44:10.951237 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-ff15a8ab-df15-48eb-9dc9-a4874c4a2261 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:10.959311 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-ff15a8ab-df15-48eb-9dc9-a4874c4a2261 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a" status: 200 len: 1682 microversion: 2.1 time: 0.155873 Aug 09 02:44:10.959876 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 245/476] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:44:10 2022] GET /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:44:11.438311 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-72813282-97ce-4c50-a676-ee62ae9ac400 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:11.438935 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-72813282-97ce-4c50-a676-ee62ae9ac400 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:11.446649 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-72813282-97ce-4c50-a676-ee62ae9ac400 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:11.447403 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-72813282-97ce-4c50-a676-ee62ae9ac400 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:11.447531 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-72813282-97ce-4c50-a676-ee62ae9ac400 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:11.448248 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-72813282-97ce-4c50-a676-ee62ae9ac400 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:11.448694 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-72813282-97ce-4c50-a676-ee62ae9ac400 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:11.449127 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-72813282-97ce-4c50-a676-ee62ae9ac400 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:11.585338 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-72813282-97ce-4c50-a676-ee62ae9ac400 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:11.596622 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-72813282-97ce-4c50-a676-ee62ae9ac400 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:11.598117 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-72813282-97ce-4c50-a676-ee62ae9ac400 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:11.599307 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-72813282-97ce-4c50-a676-ee62ae9ac400 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1724 microversion: 2.20 time: 0.165625 Aug 09 02:44:11.599881 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 232/477] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:44:11 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:44:11.890093 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-ceb64678-3efe-4418-9cd0-c467032793ec tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:11.891105 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-ceb64678-3efe-4418-9cd0-c467032793ec tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:11.902031 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ceb64678-3efe-4418-9cd0-c467032793ec tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:11.902885 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ceb64678-3efe-4418-9cd0-c467032793ec tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:11.903597 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ceb64678-3efe-4418-9cd0-c467032793ec tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:11.904727 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ceb64678-3efe-4418-9cd0-c467032793ec tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:11.905479 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ceb64678-3efe-4418-9cd0-c467032793ec tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:11.906136 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ceb64678-3efe-4418-9cd0-c467032793ec tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:11.980965 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-2a615db4-ed8e-4991-a35d-5768ce781a43 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:11.981570 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-2a615db4-ed8e-4991-a35d-5768ce781a43 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:11.987998 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2a615db4-ed8e-4991-a35d-5768ce781a43 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:11.988475 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2a615db4-ed8e-4991-a35d-5768ce781a43 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:11.988903 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2a615db4-ed8e-4991-a35d-5768ce781a43 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:11.989613 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2a615db4-ed8e-4991-a35d-5768ce781a43 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:11.990052 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2a615db4-ed8e-4991-a35d-5768ce781a43 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:11.990488 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2a615db4-ed8e-4991-a35d-5768ce781a43 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:12.071968 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-ceb64678-3efe-4418-9cd0-c467032793ec tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:12.079998 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-ceb64678-3efe-4418-9cd0-c467032793ec tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 200 len: 1676 microversion: 2.1 time: 0.196381 Aug 09 02:44:12.080576 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 246/478] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:44:11 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 1676 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:44:12.131717 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-2a615db4-ed8e-4991-a35d-5768ce781a43 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:12.139411 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-2a615db4-ed8e-4991-a35d-5768ce781a43 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a" status: 200 len: 1682 microversion: 2.1 time: 0.162350 Aug 09 02:44:12.139980 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 233/479] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:44:11 2022] GET /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:44:12.623196 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-d4fb7e3f-08dc-44a3-80be-038c695b4fb9 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:12.623806 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-d4fb7e3f-08dc-44a3-80be-038c695b4fb9 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:12.629945 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d4fb7e3f-08dc-44a3-80be-038c695b4fb9 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:12.630466 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d4fb7e3f-08dc-44a3-80be-038c695b4fb9 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:12.630905 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d4fb7e3f-08dc-44a3-80be-038c695b4fb9 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:12.631593 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d4fb7e3f-08dc-44a3-80be-038c695b4fb9 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:12.632071 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d4fb7e3f-08dc-44a3-80be-038c695b4fb9 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:12.632494 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d4fb7e3f-08dc-44a3-80be-038c695b4fb9 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:12.863686 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-d4fb7e3f-08dc-44a3-80be-038c695b4fb9 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:12.872006 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-d4fb7e3f-08dc-44a3-80be-038c695b4fb9 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:12.873512 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-d4fb7e3f-08dc-44a3-80be-038c695b4fb9 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:12.874723 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-d4fb7e3f-08dc-44a3-80be-038c695b4fb9 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1745 microversion: 2.20 time: 0.255510 Aug 09 02:44:12.875286 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 247/480] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:44:12 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1745 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:44:13.102786 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-c087b30d-eae0-40fb-b5f9-e232ff1ace5c tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:13.104122 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-c087b30d-eae0-40fb-b5f9-e232ff1ace5c tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:13.111270 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c087b30d-eae0-40fb-b5f9-e232ff1ace5c tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:13.111828 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c087b30d-eae0-40fb-b5f9-e232ff1ace5c tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:13.112372 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c087b30d-eae0-40fb-b5f9-e232ff1ace5c tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:13.113165 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c087b30d-eae0-40fb-b5f9-e232ff1ace5c tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:13.113750 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c087b30d-eae0-40fb-b5f9-e232ff1ace5c tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:13.114293 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c087b30d-eae0-40fb-b5f9-e232ff1ace5c tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:13.161367 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-fb864f12-d1d6-4b0f-956b-03190f82cc8c tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:13.163872 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-fb864f12-d1d6-4b0f-956b-03190f82cc8c tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:13.170179 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-fb864f12-d1d6-4b0f-956b-03190f82cc8c tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:13.170645 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-fb864f12-d1d6-4b0f-956b-03190f82cc8c tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:13.171208 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-fb864f12-d1d6-4b0f-956b-03190f82cc8c tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:13.171904 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-fb864f12-d1d6-4b0f-956b-03190f82cc8c tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:13.172346 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-fb864f12-d1d6-4b0f-956b-03190f82cc8c tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:13.172737 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-fb864f12-d1d6-4b0f-956b-03190f82cc8c tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:13.265426 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-fb864f12-d1d6-4b0f-956b-03190f82cc8c tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:13.273079 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-fb864f12-d1d6-4b0f-956b-03190f82cc8c tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a" status: 200 len: 1614 microversion: 2.1 time: 0.115980 Aug 09 02:44:13.273844 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 248/481] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:44:13 2022] GET /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a => generated 1614 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:44:13.311596 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-c087b30d-eae0-40fb-b5f9-e232ff1ace5c tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:13.319629 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-c087b30d-eae0-40fb-b5f9-e232ff1ace5c tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 200 len: 1676 microversion: 2.1 time: 0.223208 Aug 09 02:44:13.320205 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 234/482] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:44:13 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 1676 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:44:13.480860 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [req-828f3be6-64a6-41e8-96f4-24a8eaa2d52e req-4c3e845b-a6ac-4eb0-a17d-97c30d55d3f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a", "name": "network-vif-deleted", "tag": "78354ed7-300a-4712-933c-8e98c2dff363"}]} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:44:13.491448 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-828f3be6-64a6-41e8-96f4-24a8eaa2d52e req-4c3e845b-a6ac-4eb0-a17d-97c30d55d3f1 service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:13.492608 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-828f3be6-64a6-41e8-96f4-24a8eaa2d52e req-4c3e845b-a6ac-4eb0-a17d-97c30d55d3f1 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:13.493042 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-828f3be6-64a6-41e8-96f4-24a8eaa2d52e req-4c3e845b-a6ac-4eb0-a17d-97c30d55d3f1 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:13.505901 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.compute.server_external_events [req-828f3be6-64a6-41e8-96f4-24a8eaa2d52e req-4c3e845b-a6ac-4eb0-a17d-97c30d55d3f1 service nova] Creating event network-vif-deleted:78354ed7-300a-4712-933c-8e98c2dff363 for instance e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a on hv-cinder-85246 Aug 09 02:44:13.510663 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [req-828f3be6-64a6-41e8-96f4-24a8eaa2d52e req-4c3e845b-a6ac-4eb0-a17d-97c30d55d3f1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033503 Aug 09 02:44:13.511434 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 249/483] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:44:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:44:13.897297 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-f873c3ef-a9b1-4dcd-8c42-b15ffc6ddbe4 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:13.898052 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-f873c3ef-a9b1-4dcd-8c42-b15ffc6ddbe4 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:13.904945 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f873c3ef-a9b1-4dcd-8c42-b15ffc6ddbe4 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:13.905434 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f873c3ef-a9b1-4dcd-8c42-b15ffc6ddbe4 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:13.906196 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f873c3ef-a9b1-4dcd-8c42-b15ffc6ddbe4 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:13.906905 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f873c3ef-a9b1-4dcd-8c42-b15ffc6ddbe4 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:13.907377 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f873c3ef-a9b1-4dcd-8c42-b15ffc6ddbe4 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:13.907822 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f873c3ef-a9b1-4dcd-8c42-b15ffc6ddbe4 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:14.044196 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-f873c3ef-a9b1-4dcd-8c42-b15ffc6ddbe4 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:14.052642 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-f873c3ef-a9b1-4dcd-8c42-b15ffc6ddbe4 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:14.054327 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-f873c3ef-a9b1-4dcd-8c42-b15ffc6ddbe4 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:14.055586 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-f873c3ef-a9b1-4dcd-8c42-b15ffc6ddbe4 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1745 microversion: 2.20 time: 0.162356 Aug 09 02:44:14.056486 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 235/484] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:44:13 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1745 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:44:14.295255 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-69f2dd44-cc80-4d7f-b507-ce44ac47ac25 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:14.295962 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-69f2dd44-cc80-4d7f-b507-ce44ac47ac25 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:14.302652 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-69f2dd44-cc80-4d7f-b507-ce44ac47ac25 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:14.303317 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-69f2dd44-cc80-4d7f-b507-ce44ac47ac25 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:14.303996 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-69f2dd44-cc80-4d7f-b507-ce44ac47ac25 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:14.304893 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-69f2dd44-cc80-4d7f-b507-ce44ac47ac25 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:14.305490 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-69f2dd44-cc80-4d7f-b507-ce44ac47ac25 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:14.305901 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-69f2dd44-cc80-4d7f-b507-ce44ac47ac25 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:14.320199 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.wsgi [None req-69f2dd44-cc80-4d7f-b507-ce44ac47ac25 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] HTTP exception thrown: Instance e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a could not be found. Aug 09 02:44:14.321877 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-69f2dd44-cc80-4d7f-b507-ce44ac47ac25 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Request method failure captured: Aug 09 02:44:14.321877 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: request: GET /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a HTTP/1.1 Aug 09 02:44:14.321877 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Accept: application/json Aug 09 02:44:14.321877 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Accept-Encoding: identity Aug 09 02:44:14.321877 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Connection: close Aug 09 02:44:14.321877 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Content-Length: 0 Aug 09 02:44:14.321877 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Content-Type: application/json Aug 09 02:44:14.321877 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Host: 10.222.0.20 Aug 09 02:44:14.321877 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Openstack-System-Scope: None Aug 09 02:44:14.321877 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: User-Agent: python-urllib3/1.26.11 Aug 09 02:44:14.321877 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Auth-Token: gAAAAABi8ckjyQvMSPVjOXRhh70Rnc1ANMFv7G7JLArfSACfDLzvvcneDlsL-sI9hF681zwEIODxGFE7k1OsPJO-SGVxluvBNMmaFLG_fx-H9D1ZvGPLVeuDO_toy5qwJovkKz9pwj7m5cniNs8yMlVJKkLfQNx_gl4pQZFRtesItHh6k1DiYvw Aug 09 02:44:14.321877 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Domain-Id: None Aug 09 02:44:14.321877 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Domain-Name: None Aug 09 02:44:14.321877 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Identity-Status: Confirmed Aug 09 02:44:14.321877 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Is-Admin-Project: True Aug 09 02:44:14.321877 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Domain-Id: default Aug 09 02:44:14.321877 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Domain-Name: Default Aug 09 02:44:14.321877 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Id: 8ce26c854fc24cadb2be5ebd441b8f3a Aug 09 02:44:14.321877 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Name: tempest-AttachVolumeNegativeTest-1568455203 Aug 09 02:44:14.321877 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Role: reader,member Aug 09 02:44:14.321877 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Roles: reader,member Aug 09 02:44:14.323285 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8ce26c854fc24cadb2be5ebd441b8f3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8ce26c854fc24cadb2be5ebd441b8f3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8ce26c854fc24cadb2be5ebd441b8f3a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8ce26c854fc24cadb2be5ebd441b8f3a"}]}] Aug 09 02:44:14.323285 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant: tempest-AttachVolumeNegativeTest-1568455203 Aug 09 02:44:14.323285 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant-Id: 8ce26c854fc24cadb2be5ebd441b8f3a Aug 09 02:44:14.323285 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1568455203 Aug 09 02:44:14.323285 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User: tempest-AttachVolumeNegativeTest-1568455203-project Aug 09 02:44:14.323285 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Domain-Id: default Aug 09 02:44:14.323285 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Domain-Name: Default Aug 09 02:44:14.323285 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Id: 43232b9b191047f9a3e6ebab7ad36f02 Aug 09 02:44:14.323285 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Name: tempest-AttachVolumeNegativeTest-1568455203-project Aug 09 02:44:14.323285 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: method: > Aug 09 02:44:14.323285 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: exception: Instance e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a could not be found. Aug 09 02:44:14.323285 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: action_args: {'id': 'e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a'} Aug 09 02:44:14.324226 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 02:44:14.324226 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:44:14.324226 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 02:44:14.324226 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 02:44:14.324226 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 02:44:14.324226 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 02:44:14.324226 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 02:44:14.324226 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 02:44:14.324226 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 02:44:14.324226 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 02:44:14.324226 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a could not be found. Aug 09 02:44:14.324226 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:44:14.324226 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:44:14.324226 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:44:14.324226 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:44:14.324226 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:44:14.324226 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:44:14.324226 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 02:44:14.324226 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 02:44:14.324226 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 02:44:14.325357 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 02:44:14.325357 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 02:44:14.325357 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 02:44:14.325357 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 02:44:14.325357 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 02:44:14.325357 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 02:44:14.325357 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 02:44:14.325357 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a could not be found. Aug 09 02:44:14.325357 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:44:14.325357 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:44:14.325357 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:44:14.325357 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:44:14.325357 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:44:14.325357 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:44:14.325357 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 02:44:14.325357 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 02:44:14.325357 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a could not be found. Aug 09 02:44:14.325357 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:44:14.326472 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-69f2dd44-cc80-4d7f-b507-ce44ac47ac25 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Returning 404 to user: Instance e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a could not be found. {{(pid=124427) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 02:44:14.326472 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-69f2dd44-cc80-4d7f-b507-ce44ac47ac25 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a" status: 404 len: 111 microversion: 2.1 time: 0.032859 Aug 09 02:44:14.326472 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 250/485] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:44:14 2022] GET /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 02:44:14.332498 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-203de06c-8984-4470-9c69-75635b41cde3 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '.version_select at 0x7fb0a0435820>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:14.341521 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-8fe60ca0-358f-4313-880e-8f8735d898f5 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:14.342243 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-8fe60ca0-358f-4313-880e-8f8735d898f5 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:14.352653 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8fe60ca0-358f-4313-880e-8f8735d898f5 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:14.353952 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8fe60ca0-358f-4313-880e-8f8735d898f5 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:14.354450 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8fe60ca0-358f-4313-880e-8f8735d898f5 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:14.354924 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-203de06c-8984-4470-9c69-75635b41cde3 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-694358221" status: 202 len: 0 microversion: 2.1 time: 0.026147 Aug 09 02:44:14.355150 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8fe60ca0-358f-4313-880e-8f8735d898f5 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:14.355590 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8fe60ca0-358f-4313-880e-8f8735d898f5 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:14.355711 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 236/486] 10.222.0.20 () {58 vars in 1218 bytes} [Tue Aug 9 02:44:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-694358221 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 02:44:14.356339 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8fe60ca0-358f-4313-880e-8f8735d898f5 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:14.508581 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-8fe60ca0-358f-4313-880e-8f8735d898f5 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:14.517077 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-8fe60ca0-358f-4313-880e-8f8735d898f5 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 200 len: 1676 microversion: 2.1 time: 0.180223 Aug 09 02:44:14.531329 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 251/487] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:44:14 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 1676 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:44:15.078258 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-3c7b67c4-ac52-476c-84f3-e67569cf4dc1 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:15.078925 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-3c7b67c4-ac52-476c-84f3-e67569cf4dc1 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:15.086199 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3c7b67c4-ac52-476c-84f3-e67569cf4dc1 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:15.086910 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3c7b67c4-ac52-476c-84f3-e67569cf4dc1 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:15.087363 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3c7b67c4-ac52-476c-84f3-e67569cf4dc1 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:15.088131 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3c7b67c4-ac52-476c-84f3-e67569cf4dc1 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:15.088759 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3c7b67c4-ac52-476c-84f3-e67569cf4dc1 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:15.089179 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3c7b67c4-ac52-476c-84f3-e67569cf4dc1 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:15.300695 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-3c7b67c4-ac52-476c-84f3-e67569cf4dc1 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:15.317618 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-3c7b67c4-ac52-476c-84f3-e67569cf4dc1 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:15.317618 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-3c7b67c4-ac52-476c-84f3-e67569cf4dc1 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:15.317618 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-3c7b67c4-ac52-476c-84f3-e67569cf4dc1 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1745 microversion: 2.20 time: 0.242351 Aug 09 02:44:15.326588 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-b8ab4399-cca4-4eab-92e9-36346b6dc7ad tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Action: 'create', calling method: .version_select at 0x7fb0a0307820>, body: {"keypair": {"name": "tempest-keypair-135680751", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMmREORWDNqfsMZewnYNhb/t9Dhpm4GgcMCu6dRNo980UlQWpbVPB8A4cSl2CBe9U0GyfRwJYz9BffqRMFjZMV+7ZcRpW4QnwCP3tVoWFQIA18xU+c28k/xZ2ODXZMsg9g=="}} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:44:15.327171 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 237/488] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:44:15 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1745 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:44:15.343547 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.quota [None req-b8ab4399-cca4-4eab-92e9-36346b6dc7ad tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Getting quotas for project 8ce26c854fc24cadb2be5ebd441b8f3a. Resources: {'key_pairs'} {{(pid=124427) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 02:44:15.347270 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.quota [None req-b8ab4399-cca4-4eab-92e9-36346b6dc7ad tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Getting quotas for user 43232b9b191047f9a3e6ebab7ad36f02 and project 8ce26c854fc24cadb2be5ebd441b8f3a. Resources: {'key_pairs'} {{(pid=124427) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 02:44:15.371234 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-b8ab4399-cca4-4eab-92e9-36346b6dc7ad tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048467 Aug 09 02:44:15.371833 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 252/489] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Aug 9 02:44:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 02:44:15.538251 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-a8fdf7d2-0377-47ea-9193-e8d301693291 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:15.539584 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-a8fdf7d2-0377-47ea-9193-e8d301693291 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:15.546276 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a8fdf7d2-0377-47ea-9193-e8d301693291 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:15.547001 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a8fdf7d2-0377-47ea-9193-e8d301693291 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:15.547704 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a8fdf7d2-0377-47ea-9193-e8d301693291 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:15.548567 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a8fdf7d2-0377-47ea-9193-e8d301693291 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:15.549151 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a8fdf7d2-0377-47ea-9193-e8d301693291 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:15.549754 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a8fdf7d2-0377-47ea-9193-e8d301693291 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:15.770698 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-a8fdf7d2-0377-47ea-9193-e8d301693291 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:15.778761 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-a8fdf7d2-0377-47ea-9193-e8d301693291 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 200 len: 1676 microversion: 2.1 time: 0.244388 Aug 09 02:44:15.779341 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 238/490] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:44:15 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 1676 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:44:16.340016 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-268200fb-15da-4433-b1cd-721949e2d658 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:16.340629 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-268200fb-15da-4433-b1cd-721949e2d658 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:16.353340 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-268200fb-15da-4433-b1cd-721949e2d658 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:16.354050 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-268200fb-15da-4433-b1cd-721949e2d658 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:16.354538 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-268200fb-15da-4433-b1cd-721949e2d658 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:16.355634 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-268200fb-15da-4433-b1cd-721949e2d658 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:16.356243 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-268200fb-15da-4433-b1cd-721949e2d658 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:16.356797 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-268200fb-15da-4433-b1cd-721949e2d658 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:16.526877 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-268200fb-15da-4433-b1cd-721949e2d658 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:16.548254 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-268200fb-15da-4433-b1cd-721949e2d658 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:16.549751 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-268200fb-15da-4433-b1cd-721949e2d658 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:16.551168 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-268200fb-15da-4433-b1cd-721949e2d658 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1740 microversion: 2.20 time: 0.215296 Aug 09 02:44:16.552209 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 253/491] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:44:16 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1740 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:44:16.799575 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-62da2765-c2a3-4e9b-a4f4-e0a1fa55b0f5 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:16.800912 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-62da2765-c2a3-4e9b-a4f4-e0a1fa55b0f5 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:16.811205 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-62da2765-c2a3-4e9b-a4f4-e0a1fa55b0f5 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:16.812180 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-62da2765-c2a3-4e9b-a4f4-e0a1fa55b0f5 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:16.813029 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-62da2765-c2a3-4e9b-a4f4-e0a1fa55b0f5 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:16.814013 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-62da2765-c2a3-4e9b-a4f4-e0a1fa55b0f5 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:16.814790 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-62da2765-c2a3-4e9b-a4f4-e0a1fa55b0f5 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:16.815563 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-62da2765-c2a3-4e9b-a4f4-e0a1fa55b0f5 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:16.948108 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-95ecf124-d101-4182-9edf-d704c07f285d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-350221112", "imageRef": "04a06944-b2a8-4a65-b2a6-7ed3ff18a627", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6bf516e7-9ea4-4f2e-9b3b-a70a745206d7"}], "security_groups": [{"name": "tempest-securitygroup--762503863"}], "key_name": "tempest-keypair-135680751", "user_data": "}} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:44:17.003823 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-62da2765-c2a3-4e9b-a4f4-e0a1fa55b0f5 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:17.014498 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-62da2765-c2a3-4e9b-a4f4-e0a1fa55b0f5 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 200 len: 1676 microversion: 2.1 time: 0.218677 Aug 09 02:44:17.027963 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 239/492] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:44:16 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 1676 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:44:17.076481 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.network.neutron [None req-95ecf124-d101-4182-9edf-d704c07f285d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] validate_networks() for [('6bf516e7-9ea4-4f2e-9b3b-a70a745206d7', None, None, None, None, None)] {{(pid=124427) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 02:44:17.242580 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [req-6562f36d-a61c-46e2-9287-0150edeea237 req-1541ca3e-b506-40f2-98bd-d4198aef7717 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9919dd32-c9e0-42ae-8981-414c2e663e73", "name": "network-vif-plugged", "status": "completed", "tag": "e32a0be8-e008-4397-89d0-66d5a85e0515"}]} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:44:17.265674 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-6562f36d-a61c-46e2-9287-0150edeea237 req-1541ca3e-b506-40f2-98bd-d4198aef7717 service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:17.266196 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-6562f36d-a61c-46e2-9287-0150edeea237 req-1541ca3e-b506-40f2-98bd-d4198aef7717 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:17.267494 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-6562f36d-a61c-46e2-9287-0150edeea237 req-1541ca3e-b506-40f2-98bd-d4198aef7717 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:17.281802 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.compute.server_external_events [req-6562f36d-a61c-46e2-9287-0150edeea237 req-1541ca3e-b506-40f2-98bd-d4198aef7717 service nova] Creating event network-vif-plugged:e32a0be8-e008-4397-89d0-66d5a85e0515 for instance 9919dd32-c9e0-42ae-8981-414c2e663e73 on hv-cinder-85246 Aug 09 02:44:17.287419 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [req-6562f36d-a61c-46e2-9287-0150edeea237 req-1541ca3e-b506-40f2-98bd-d4198aef7717 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051682 Aug 09 02:44:17.288257 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 240/493] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:44:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:44:17.542054 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.virt.hardware [None req-95ecf124-d101-4182-9edf-d704c07f285d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Flavor limits 0:0:0 {{(pid=124427) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 02:44:17.544010 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.virt.hardware [None req-95ecf124-d101-4182-9edf-d704c07f285d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Image limits 0:0:0 {{(pid=124427) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 02:44:17.544684 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.virt.hardware [None req-95ecf124-d101-4182-9edf-d704c07f285d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Flavor pref 0:0:0 {{(pid=124427) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 02:44:17.545381 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.virt.hardware [None req-95ecf124-d101-4182-9edf-d704c07f285d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Image pref 0:0:0 {{(pid=124427) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 02:44:17.545953 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.virt.hardware [None req-95ecf124-d101-4182-9edf-d704c07f285d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124427) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 02:44:17.576666 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-06f793ac-25d0-42cc-bd60-c62af00da17d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:17.577848 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-06f793ac-25d0-42cc-bd60-c62af00da17d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:17.581846 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-95ecf124-d101-4182-9edf-d704c07f285d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:17.583438 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-95ecf124-d101-4182-9edf-d704c07f285d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:17.584689 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-95ecf124-d101-4182-9edf-d704c07f285d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:17.585732 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-95ecf124-d101-4182-9edf-d704c07f285d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:17.589397 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-95ecf124-d101-4182-9edf-d704c07f285d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:17.590111 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-95ecf124-d101-4182-9edf-d704c07f285d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:17.609655 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-06f793ac-25d0-42cc-bd60-c62af00da17d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:17.610671 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-06f793ac-25d0-42cc-bd60-c62af00da17d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:17.611408 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-06f793ac-25d0-42cc-bd60-c62af00da17d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:17.612404 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-06f793ac-25d0-42cc-bd60-c62af00da17d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:17.613125 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-06f793ac-25d0-42cc-bd60-c62af00da17d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:17.613772 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-06f793ac-25d0-42cc-bd60-c62af00da17d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:17.618310 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.quota [None req-95ecf124-d101-4182-9edf-d704c07f285d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Getting quotas for project 8ce26c854fc24cadb2be5ebd441b8f3a. Resources: {'cores', 'ram', 'instances'} {{(pid=124427) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 02:44:17.623252 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.quota [None req-95ecf124-d101-4182-9edf-d704c07f285d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Getting quotas for user 43232b9b191047f9a3e6ebab7ad36f02 and project 8ce26c854fc24cadb2be5ebd441b8f3a. Resources: {'cores', 'ram', 'instances'} {{(pid=124427) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 02:44:17.640441 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:44:17.642556 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-95ecf124-d101-4182-9edf-d704c07f285d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Going to run 1 instances... {{(pid=124427) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 02:44:17.645338 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-95ecf124-d101-4182-9edf-d704c07f285d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 3cda6c0b-68ff-41dd-aa38-48cbafba8451] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='04a06944-b2a8-4a65-b2a6-7ed3ff18a627',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124427) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 02:44:17.706564 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-95ecf124-d101-4182-9edf-d704c07f285d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.762594 Aug 09 02:44:17.713621 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 254/494] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Aug 9 02:44:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 02:44:17.719798 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-8dd97f45-11c1-4cfc-8854-09fb0528fdc7 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:17.720697 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-8dd97f45-11c1-4cfc-8854-09fb0528fdc7 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 3cda6c0b-68ff-41dd-aa38-48cbafba8451] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:17.787344 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-06f793ac-25d0-42cc-bd60-c62af00da17d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:17.800899 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-06f793ac-25d0-42cc-bd60-c62af00da17d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:17.805193 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-06f793ac-25d0-42cc-bd60-c62af00da17d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:17.813355 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-06f793ac-25d0-42cc-bd60-c62af00da17d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1740 microversion: 2.20 time: 0.241340 Aug 09 02:44:17.814622 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 241/495] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:44:17 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1740 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:44:17.854351 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-8dd97f45-11c1-4cfc-8854-09fb0528fdc7 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:17.862925 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-8dd97f45-11c1-4cfc-8854-09fb0528fdc7 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/3cda6c0b-68ff-41dd-aa38-48cbafba8451" status: 200 len: 1240 microversion: 2.1 time: 0.147754 Aug 09 02:44:17.863509 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 255/496] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:44:17 2022] GET /compute/v2.1/servers/3cda6c0b-68ff-41dd-aa38-48cbafba8451 => generated 1240 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:44:18.035900 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-3ceda4ca-057f-43a8-a0c2-ea6db9ef3b53 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:18.036530 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-3ceda4ca-057f-43a8-a0c2-ea6db9ef3b53 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:18.045784 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3ceda4ca-057f-43a8-a0c2-ea6db9ef3b53 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:18.046382 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3ceda4ca-057f-43a8-a0c2-ea6db9ef3b53 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:18.046816 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3ceda4ca-057f-43a8-a0c2-ea6db9ef3b53 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:18.047537 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3ceda4ca-057f-43a8-a0c2-ea6db9ef3b53 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:18.047991 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3ceda4ca-057f-43a8-a0c2-ea6db9ef3b53 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:18.048402 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3ceda4ca-057f-43a8-a0c2-ea6db9ef3b53 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:18.214474 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-3ceda4ca-057f-43a8-a0c2-ea6db9ef3b53 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:18.223860 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-3ceda4ca-057f-43a8-a0c2-ea6db9ef3b53 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 200 len: 1676 microversion: 2.1 time: 0.191706 Aug 09 02:44:18.224439 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 242/497] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:44:18 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 1676 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:44:18.842848 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-b7947ac3-a9e1-4bd1-8d92-0eafb696d014 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:18.844298 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-b7947ac3-a9e1-4bd1-8d92-0eafb696d014 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:18.852362 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b7947ac3-a9e1-4bd1-8d92-0eafb696d014 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:18.852837 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b7947ac3-a9e1-4bd1-8d92-0eafb696d014 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:18.853447 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b7947ac3-a9e1-4bd1-8d92-0eafb696d014 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:18.854336 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b7947ac3-a9e1-4bd1-8d92-0eafb696d014 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:18.855008 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b7947ac3-a9e1-4bd1-8d92-0eafb696d014 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:18.855553 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b7947ac3-a9e1-4bd1-8d92-0eafb696d014 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:18.873114 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:44:18.888151 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-db8ca2e3-3fe9-46c9-be0f-70f395522f4d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:18.890393 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-db8ca2e3-3fe9-46c9-be0f-70f395522f4d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 3cda6c0b-68ff-41dd-aa38-48cbafba8451] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:18.913890 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-db8ca2e3-3fe9-46c9-be0f-70f395522f4d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:18.914529 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-db8ca2e3-3fe9-46c9-be0f-70f395522f4d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:18.915215 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-db8ca2e3-3fe9-46c9-be0f-70f395522f4d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:18.916143 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-db8ca2e3-3fe9-46c9-be0f-70f395522f4d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:18.916817 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-db8ca2e3-3fe9-46c9-be0f-70f395522f4d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:18.917464 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-db8ca2e3-3fe9-46c9-be0f-70f395522f4d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:19.006800 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-db8ca2e3-3fe9-46c9-be0f-70f395522f4d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:19.015430 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-db8ca2e3-3fe9-46c9-be0f-70f395522f4d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/3cda6c0b-68ff-41dd-aa38-48cbafba8451" status: 200 len: 1292 microversion: 2.1 time: 0.136137 Aug 09 02:44:19.016353 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 243/498] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:44:18 2022] GET /compute/v2.1/servers/3cda6c0b-68ff-41dd-aa38-48cbafba8451 => generated 1292 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:44:19.036492 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-b7947ac3-a9e1-4bd1-8d92-0eafb696d014 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:19.045225 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-b7947ac3-a9e1-4bd1-8d92-0eafb696d014 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:19.047234 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-b7947ac3-a9e1-4bd1-8d92-0eafb696d014 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:19.048771 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-b7947ac3-a9e1-4bd1-8d92-0eafb696d014 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1740 microversion: 2.20 time: 0.209755 Aug 09 02:44:19.049325 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 256/499] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:44:18 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1740 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:44:19.246976 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-26fd0477-530f-4856-b477-f9569b7be633 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:19.247597 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-26fd0477-530f-4856-b477-f9569b7be633 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:19.259326 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-26fd0477-530f-4856-b477-f9569b7be633 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:19.260075 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-26fd0477-530f-4856-b477-f9569b7be633 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:19.260693 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-26fd0477-530f-4856-b477-f9569b7be633 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:19.261564 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-26fd0477-530f-4856-b477-f9569b7be633 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:19.262188 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-26fd0477-530f-4856-b477-f9569b7be633 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:19.262961 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-26fd0477-530f-4856-b477-f9569b7be633 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:19.490941 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-26fd0477-530f-4856-b477-f9569b7be633 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:19.499015 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-26fd0477-530f-4856-b477-f9569b7be633 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 200 len: 1676 microversion: 2.1 time: 0.256817 Aug 09 02:44:19.500227 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 244/500] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:44:19 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 1676 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:44:20.048101 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-6b782ff0-92a3-421c-b165-2c679e1c0ef5 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:20.049461 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-6b782ff0-92a3-421c-b165-2c679e1c0ef5 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 3cda6c0b-68ff-41dd-aa38-48cbafba8451] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:20.067836 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6b782ff0-92a3-421c-b165-2c679e1c0ef5 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:20.075868 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-0df0c142-d89a-4317-b5f6-853c67b6765b tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:20.077215 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-0df0c142-d89a-4317-b5f6-853c67b6765b tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:20.078939 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6b782ff0-92a3-421c-b165-2c679e1c0ef5 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:20.079780 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6b782ff0-92a3-421c-b165-2c679e1c0ef5 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:20.080803 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6b782ff0-92a3-421c-b165-2c679e1c0ef5 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:20.081458 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6b782ff0-92a3-421c-b165-2c679e1c0ef5 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:20.082088 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6b782ff0-92a3-421c-b165-2c679e1c0ef5 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:20.087339 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0df0c142-d89a-4317-b5f6-853c67b6765b tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:20.087838 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0df0c142-d89a-4317-b5f6-853c67b6765b tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:20.088274 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0df0c142-d89a-4317-b5f6-853c67b6765b tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:20.088980 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0df0c142-d89a-4317-b5f6-853c67b6765b tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:20.094103 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0df0c142-d89a-4317-b5f6-853c67b6765b tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:20.094624 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0df0c142-d89a-4317-b5f6-853c67b6765b tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:20.219359 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-6b782ff0-92a3-421c-b165-2c679e1c0ef5 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:20.230850 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-6b782ff0-92a3-421c-b165-2c679e1c0ef5 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/3cda6c0b-68ff-41dd-aa38-48cbafba8451" status: 200 len: 1298 microversion: 2.1 time: 0.193089 Aug 09 02:44:20.231868 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 257/501] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:44:20 2022] GET /compute/v2.1/servers/3cda6c0b-68ff-41dd-aa38-48cbafba8451 => generated 1298 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:44:20.344859 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-0df0c142-d89a-4317-b5f6-853c67b6765b tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:20.359547 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-0df0c142-d89a-4317-b5f6-853c67b6765b tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:20.361154 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-0df0c142-d89a-4317-b5f6-853c67b6765b tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:20.364326 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-0df0c142-d89a-4317-b5f6-853c67b6765b tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1740 microversion: 2.20 time: 0.293039 Aug 09 02:44:20.365414 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 245/502] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:44:20 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1740 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:44:20.520941 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-49541e31-d019-4777-89b7-81b903796076 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:20.521943 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-49541e31-d019-4777-89b7-81b903796076 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:20.528847 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-49541e31-d019-4777-89b7-81b903796076 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:20.529399 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-49541e31-d019-4777-89b7-81b903796076 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:20.530197 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-49541e31-d019-4777-89b7-81b903796076 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:20.531008 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-49541e31-d019-4777-89b7-81b903796076 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:20.531519 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-49541e31-d019-4777-89b7-81b903796076 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:20.532003 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-49541e31-d019-4777-89b7-81b903796076 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:20.762509 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-49541e31-d019-4777-89b7-81b903796076 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:20.770909 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-49541e31-d019-4777-89b7-81b903796076 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 200 len: 1676 microversion: 2.1 time: 0.254223 Aug 09 02:44:20.771830 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 258/503] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:44:20 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 1676 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:44:21.266022 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-2a050049-c6dd-4fa4-a87d-743125bbdd26 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:21.266836 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-2a050049-c6dd-4fa4-a87d-743125bbdd26 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 3cda6c0b-68ff-41dd-aa38-48cbafba8451] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:21.283060 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2a050049-c6dd-4fa4-a87d-743125bbdd26 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:21.290951 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2a050049-c6dd-4fa4-a87d-743125bbdd26 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:21.291491 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2a050049-c6dd-4fa4-a87d-743125bbdd26 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:21.292268 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2a050049-c6dd-4fa4-a87d-743125bbdd26 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:21.292722 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2a050049-c6dd-4fa4-a87d-743125bbdd26 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:21.293434 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2a050049-c6dd-4fa4-a87d-743125bbdd26 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:21.394385 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-a819b5d9-e517-4483-ab3d-e40bf4ebf103 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:21.395756 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-a819b5d9-e517-4483-ab3d-e40bf4ebf103 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:21.403122 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a819b5d9-e517-4483-ab3d-e40bf4ebf103 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:21.404662 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a819b5d9-e517-4483-ab3d-e40bf4ebf103 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:21.405095 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a819b5d9-e517-4483-ab3d-e40bf4ebf103 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:21.405922 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a819b5d9-e517-4483-ab3d-e40bf4ebf103 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:21.406550 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a819b5d9-e517-4483-ab3d-e40bf4ebf103 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:21.407144 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a819b5d9-e517-4483-ab3d-e40bf4ebf103 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:21.600591 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-2a050049-c6dd-4fa4-a87d-743125bbdd26 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:21.617417 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-2a050049-c6dd-4fa4-a87d-743125bbdd26 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/3cda6c0b-68ff-41dd-aa38-48cbafba8451" status: 200 len: 1365 microversion: 2.1 time: 0.356420 Aug 09 02:44:21.630185 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 246/504] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:44:21 2022] GET /compute/v2.1/servers/3cda6c0b-68ff-41dd-aa38-48cbafba8451 => generated 1365 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:44:21.636561 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-a819b5d9-e517-4483-ab3d-e40bf4ebf103 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:21.647065 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-a819b5d9-e517-4483-ab3d-e40bf4ebf103 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:21.648777 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-a819b5d9-e517-4483-ab3d-e40bf4ebf103 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:21.649526 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [req-5f1d687d-cd0b-43a6-8af9-fe120811d11f req-df44d2fc-772a-4289-b6ed-ba6fe68de073 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cda6c0b-68ff-41dd-aa38-48cbafba8451", "tag": "dd6d3011-7693-4d78-b859-3220bb048c68"}]} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:44:21.651032 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-a819b5d9-e517-4483-ab3d-e40bf4ebf103 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1740 microversion: 2.20 time: 0.261039 Aug 09 02:44:21.652601 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 259/505] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:44:21 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1740 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:44:21.663530 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-5f1d687d-cd0b-43a6-8af9-fe120811d11f req-df44d2fc-772a-4289-b6ed-ba6fe68de073 service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:21.664015 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-5f1d687d-cd0b-43a6-8af9-fe120811d11f req-df44d2fc-772a-4289-b6ed-ba6fe68de073 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:21.664821 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-5f1d687d-cd0b-43a6-8af9-fe120811d11f req-df44d2fc-772a-4289-b6ed-ba6fe68de073 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:21.693384 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.compute.server_external_events [req-5f1d687d-cd0b-43a6-8af9-fe120811d11f req-df44d2fc-772a-4289-b6ed-ba6fe68de073 service nova] Creating event network-changed:dd6d3011-7693-4d78-b859-3220bb048c68 for instance 3cda6c0b-68ff-41dd-aa38-48cbafba8451 on hv-cinder-85246 Aug 09 02:44:21.698585 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [req-5f1d687d-cd0b-43a6-8af9-fe120811d11f req-df44d2fc-772a-4289-b6ed-ba6fe68de073 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052647 Aug 09 02:44:21.699522 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 247/506] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:44:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 02:44:21.792988 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-5a293875-94ee-4a45-8d8e-59a480894587 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:21.801194 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-fc48f363-65a7-42da-9fa1-19235bd7abb4 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "553e3daa-06f7-485f-8835-4e102fd8880c"}} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:44:21.803800 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-5a293875-94ee-4a45-8d8e-59a480894587 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:21.808868 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-fc48f363-65a7-42da-9fa1-19235bd7abb4 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: b9369cf3-95d7-41d2-8157-ca2c165b062d] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:21.814614 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5a293875-94ee-4a45-8d8e-59a480894587 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:21.815092 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5a293875-94ee-4a45-8d8e-59a480894587 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:21.815720 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5a293875-94ee-4a45-8d8e-59a480894587 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:21.816570 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5a293875-94ee-4a45-8d8e-59a480894587 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:21.817293 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5a293875-94ee-4a45-8d8e-59a480894587 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:21.817879 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5a293875-94ee-4a45-8d8e-59a480894587 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:21.822982 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-fc48f363-65a7-42da-9fa1-19235bd7abb4 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:21.823613 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-fc48f363-65a7-42da-9fa1-19235bd7abb4 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:21.823930 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-fc48f363-65a7-42da-9fa1-19235bd7abb4 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:21.824663 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-fc48f363-65a7-42da-9fa1-19235bd7abb4 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:21.826364 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-fc48f363-65a7-42da-9fa1-19235bd7abb4 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:21.826364 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-fc48f363-65a7-42da-9fa1-19235bd7abb4 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:22.075351 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-5a293875-94ee-4a45-8d8e-59a480894587 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:22.090876 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-5a293875-94ee-4a45-8d8e-59a480894587 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 200 len: 1676 microversion: 2.1 time: 0.300596 Aug 09 02:44:22.091495 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 260/507] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:44:21 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 1676 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:44:22.208920 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-fc48f363-65a7-42da-9fa1-19235bd7abb4 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "POST /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.413601 Aug 09 02:44:22.215858 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 248/508] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Aug 9 02:44:21 2022] POST /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d/os-volume_attachments => generated 194 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:44:22.641429 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-0e228777-c58a-4d42-b232-f275279c27cd tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:22.642780 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-0e228777-c58a-4d42-b232-f275279c27cd tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 3cda6c0b-68ff-41dd-aa38-48cbafba8451] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:22.650540 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0e228777-c58a-4d42-b232-f275279c27cd tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:22.651322 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0e228777-c58a-4d42-b232-f275279c27cd tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:22.651748 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0e228777-c58a-4d42-b232-f275279c27cd tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:22.652463 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0e228777-c58a-4d42-b232-f275279c27cd tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:22.652906 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0e228777-c58a-4d42-b232-f275279c27cd tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:22.653323 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0e228777-c58a-4d42-b232-f275279c27cd tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:22.679522 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-77e49950-ded2-46c0-8057-a026cbe8e1dd tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:22.680837 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-77e49950-ded2-46c0-8057-a026cbe8e1dd tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:22.690593 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-77e49950-ded2-46c0-8057-a026cbe8e1dd tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:22.691701 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-77e49950-ded2-46c0-8057-a026cbe8e1dd tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:22.692301 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-77e49950-ded2-46c0-8057-a026cbe8e1dd tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:22.693178 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-77e49950-ded2-46c0-8057-a026cbe8e1dd tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:22.693779 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-77e49950-ded2-46c0-8057-a026cbe8e1dd tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:22.694395 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-77e49950-ded2-46c0-8057-a026cbe8e1dd tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:22.713392 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:44:22.862400 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-0e228777-c58a-4d42-b232-f275279c27cd tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:22.870385 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-0e228777-c58a-4d42-b232-f275279c27cd tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/3cda6c0b-68ff-41dd-aa38-48cbafba8451" status: 200 len: 1365 microversion: 2.1 time: 0.232667 Aug 09 02:44:22.883609 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 261/509] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:44:22 2022] GET /compute/v2.1/servers/3cda6c0b-68ff-41dd-aa38-48cbafba8451 => generated 1365 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:44:22.896151 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-77e49950-ded2-46c0-8057-a026cbe8e1dd tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:22.905386 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-77e49950-ded2-46c0-8057-a026cbe8e1dd tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:22.908441 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-77e49950-ded2-46c0-8057-a026cbe8e1dd tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:22.910612 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-77e49950-ded2-46c0-8057-a026cbe8e1dd tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1740 microversion: 2.20 time: 0.236761 Aug 09 02:44:22.911814 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 249/510] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:44:22 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1740 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 02:44:23.113575 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-a15927d0-3b41-4c91-b832-d38257d50a60 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:23.114279 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-a15927d0-3b41-4c91-b832-d38257d50a60 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:23.122812 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a15927d0-3b41-4c91-b832-d38257d50a60 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:23.123585 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a15927d0-3b41-4c91-b832-d38257d50a60 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:23.124204 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a15927d0-3b41-4c91-b832-d38257d50a60 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:23.125455 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a15927d0-3b41-4c91-b832-d38257d50a60 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:23.125911 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a15927d0-3b41-4c91-b832-d38257d50a60 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:23.126550 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a15927d0-3b41-4c91-b832-d38257d50a60 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:23.268588 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-a15927d0-3b41-4c91-b832-d38257d50a60 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:23.277157 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-a15927d0-3b41-4c91-b832-d38257d50a60 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 200 len: 1676 microversion: 2.1 time: 0.167395 Aug 09 02:44:23.277881 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 262/511] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:44:23 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 1676 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:44:23.891395 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-b7b28d8f-58ab-4701-98a8-9afb35db9a37 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:23.892669 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-b7b28d8f-58ab-4701-98a8-9afb35db9a37 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 3cda6c0b-68ff-41dd-aa38-48cbafba8451] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:23.902829 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b7b28d8f-58ab-4701-98a8-9afb35db9a37 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:23.903345 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b7b28d8f-58ab-4701-98a8-9afb35db9a37 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:23.907487 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b7b28d8f-58ab-4701-98a8-9afb35db9a37 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:23.908351 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b7b28d8f-58ab-4701-98a8-9afb35db9a37 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:23.908887 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b7b28d8f-58ab-4701-98a8-9afb35db9a37 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:23.911625 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b7b28d8f-58ab-4701-98a8-9afb35db9a37 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:23.935055 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-1c4f0f63-004d-41a7-a7ea-42e1b810b160 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:23.935680 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-1c4f0f63-004d-41a7-a7ea-42e1b810b160 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:23.945197 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1c4f0f63-004d-41a7-a7ea-42e1b810b160 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:23.945698 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1c4f0f63-004d-41a7-a7ea-42e1b810b160 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:23.946142 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1c4f0f63-004d-41a7-a7ea-42e1b810b160 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:23.947142 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1c4f0f63-004d-41a7-a7ea-42e1b810b160 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:23.947603 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1c4f0f63-004d-41a7-a7ea-42e1b810b160 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:23.948036 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1c4f0f63-004d-41a7-a7ea-42e1b810b160 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:24.264147 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-1c4f0f63-004d-41a7-a7ea-42e1b810b160 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:24.273809 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-1c4f0f63-004d-41a7-a7ea-42e1b810b160 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:24.275828 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-1c4f0f63-004d-41a7-a7ea-42e1b810b160 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:24.277320 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-1c4f0f63-004d-41a7-a7ea-42e1b810b160 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1740 microversion: 2.20 time: 0.346285 Aug 09 02:44:24.294187 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 263/512] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:44:23 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1740 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:44:24.304679 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-b7b28d8f-58ab-4701-98a8-9afb35db9a37 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:24.305178 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-9ec228eb-afcf-4c34-b26e-f2a01ea40fdc tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:24.306080 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-9ec228eb-afcf-4c34-b26e-f2a01ea40fdc tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:24.313606 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9ec228eb-afcf-4c34-b26e-f2a01ea40fdc tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:24.314447 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9ec228eb-afcf-4c34-b26e-f2a01ea40fdc tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:24.315040 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9ec228eb-afcf-4c34-b26e-f2a01ea40fdc tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:24.316043 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9ec228eb-afcf-4c34-b26e-f2a01ea40fdc tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:24.316652 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9ec228eb-afcf-4c34-b26e-f2a01ea40fdc tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:24.317295 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9ec228eb-afcf-4c34-b26e-f2a01ea40fdc tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:24.318749 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-b7b28d8f-58ab-4701-98a8-9afb35db9a37 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/3cda6c0b-68ff-41dd-aa38-48cbafba8451" status: 200 len: 1365 microversion: 2.1 time: 0.431458 Aug 09 02:44:24.322196 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 250/513] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:44:23 2022] GET /compute/v2.1/servers/3cda6c0b-68ff-41dd-aa38-48cbafba8451 => generated 1365 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:44:24.821583 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-9ec228eb-afcf-4c34-b26e-f2a01ea40fdc tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:24.829523 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-9ec228eb-afcf-4c34-b26e-f2a01ea40fdc tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 200 len: 1676 microversion: 2.1 time: 0.534500 Aug 09 02:44:24.830109 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 264/514] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:44:24 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 1676 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:44:25.308170 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-6d6559ae-f15d-4396-b13f-e6795c070765 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:25.309156 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-6d6559ae-f15d-4396-b13f-e6795c070765 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:25.317337 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6d6559ae-f15d-4396-b13f-e6795c070765 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:25.317825 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6d6559ae-f15d-4396-b13f-e6795c070765 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:25.318299 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6d6559ae-f15d-4396-b13f-e6795c070765 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:25.318991 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6d6559ae-f15d-4396-b13f-e6795c070765 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:25.319441 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6d6559ae-f15d-4396-b13f-e6795c070765 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:25.319864 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6d6559ae-f15d-4396-b13f-e6795c070765 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:25.340614 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-1cc6262f-e329-4611-ac7c-c04e10904e13 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:25.341333 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-1cc6262f-e329-4611-ac7c-c04e10904e13 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 3cda6c0b-68ff-41dd-aa38-48cbafba8451] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:25.348205 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1cc6262f-e329-4611-ac7c-c04e10904e13 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:25.348682 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1cc6262f-e329-4611-ac7c-c04e10904e13 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:25.349103 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1cc6262f-e329-4611-ac7c-c04e10904e13 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:25.349792 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1cc6262f-e329-4611-ac7c-c04e10904e13 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:25.350268 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1cc6262f-e329-4611-ac7c-c04e10904e13 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:25.350680 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1cc6262f-e329-4611-ac7c-c04e10904e13 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:25.514457 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-6d6559ae-f15d-4396-b13f-e6795c070765 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:25.522704 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-6d6559ae-f15d-4396-b13f-e6795c070765 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:25.524212 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-6d6559ae-f15d-4396-b13f-e6795c070765 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:25.525382 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-6d6559ae-f15d-4396-b13f-e6795c070765 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1740 microversion: 2.20 time: 0.223799 Aug 09 02:44:25.525536 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-1cc6262f-e329-4611-ac7c-c04e10904e13 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:25.525944 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 251/515] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:44:25 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1740 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:44:25.533176 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-1cc6262f-e329-4611-ac7c-c04e10904e13 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/3cda6c0b-68ff-41dd-aa38-48cbafba8451" status: 200 len: 1365 microversion: 2.1 time: 0.196535 Aug 09 02:44:25.533742 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 265/516] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:44:25 2022] GET /compute/v2.1/servers/3cda6c0b-68ff-41dd-aa38-48cbafba8451 => generated 1365 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:44:25.851842 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-0601d699-123f-4a67-96f5-24a9b4dabc78 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:25.852457 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-0601d699-123f-4a67-96f5-24a9b4dabc78 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:25.859438 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0601d699-123f-4a67-96f5-24a9b4dabc78 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:25.859913 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0601d699-123f-4a67-96f5-24a9b4dabc78 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:25.860335 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0601d699-123f-4a67-96f5-24a9b4dabc78 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:25.861005 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0601d699-123f-4a67-96f5-24a9b4dabc78 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:25.861454 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0601d699-123f-4a67-96f5-24a9b4dabc78 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:25.861893 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0601d699-123f-4a67-96f5-24a9b4dabc78 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:26.060239 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-0601d699-123f-4a67-96f5-24a9b4dabc78 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:26.068758 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-0601d699-123f-4a67-96f5-24a9b4dabc78 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 200 len: 1676 microversion: 2.1 time: 0.220762 Aug 09 02:44:26.069227 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 252/517] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:44:25 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 1676 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:44:26.548277 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-6f320303-f0b8-4216-9565-abaf09b2d746 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:26.548856 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-6f320303-f0b8-4216-9565-abaf09b2d746 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:26.552813 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-69f85f77-d6e8-45f4-9866-363223c312fd tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:26.553496 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-69f85f77-d6e8-45f4-9866-363223c312fd tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 3cda6c0b-68ff-41dd-aa38-48cbafba8451] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:26.555475 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6f320303-f0b8-4216-9565-abaf09b2d746 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:26.555958 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6f320303-f0b8-4216-9565-abaf09b2d746 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:26.556387 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6f320303-f0b8-4216-9565-abaf09b2d746 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:26.557084 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6f320303-f0b8-4216-9565-abaf09b2d746 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:26.557494 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6f320303-f0b8-4216-9565-abaf09b2d746 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:26.557935 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6f320303-f0b8-4216-9565-abaf09b2d746 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:26.559990 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-69f85f77-d6e8-45f4-9866-363223c312fd tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:26.560466 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-69f85f77-d6e8-45f4-9866-363223c312fd tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:26.560889 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-69f85f77-d6e8-45f4-9866-363223c312fd tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:26.561568 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-69f85f77-d6e8-45f4-9866-363223c312fd tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:26.562146 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-69f85f77-d6e8-45f4-9866-363223c312fd tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:26.562567 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-69f85f77-d6e8-45f4-9866-363223c312fd tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:26.753207 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-6f320303-f0b8-4216-9565-abaf09b2d746 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:26.756674 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-69f85f77-d6e8-45f4-9866-363223c312fd tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:26.761489 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-6f320303-f0b8-4216-9565-abaf09b2d746 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:26.763099 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-6f320303-f0b8-4216-9565-abaf09b2d746 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:26.764252 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-6f320303-f0b8-4216-9565-abaf09b2d746 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1722 microversion: 2.20 time: 0.219937 Aug 09 02:44:26.764402 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-69f85f77-d6e8-45f4-9866-363223c312fd tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/3cda6c0b-68ff-41dd-aa38-48cbafba8451" status: 200 len: 1365 microversion: 2.1 time: 0.215366 Aug 09 02:44:26.764801 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 266/518] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:44:26 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1722 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:44:26.764956 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 253/519] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:44:26 2022] GET /compute/v2.1/servers/3cda6c0b-68ff-41dd-aa38-48cbafba8451 => generated 1365 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:44:27.098333 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-edc47ed1-8858-4a7d-b27d-50efca3882ec tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:27.099323 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-edc47ed1-8858-4a7d-b27d-50efca3882ec tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:27.109590 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-edc47ed1-8858-4a7d-b27d-50efca3882ec tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:27.110062 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-edc47ed1-8858-4a7d-b27d-50efca3882ec tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:27.110545 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-edc47ed1-8858-4a7d-b27d-50efca3882ec tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:27.111197 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-edc47ed1-8858-4a7d-b27d-50efca3882ec tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:27.111647 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-edc47ed1-8858-4a7d-b27d-50efca3882ec tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:27.112063 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-edc47ed1-8858-4a7d-b27d-50efca3882ec tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:27.241721 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-edc47ed1-8858-4a7d-b27d-50efca3882ec tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:27.250074 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-edc47ed1-8858-4a7d-b27d-50efca3882ec tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 200 len: 1676 microversion: 2.1 time: 0.158169 Aug 09 02:44:27.250683 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 267/520] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:44:27 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:44:27.788594 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-c3d001f7-e2d7-4e4c-b051-c8215d34bd57 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:27.789836 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-c3d001f7-e2d7-4e4c-b051-c8215d34bd57 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 3cda6c0b-68ff-41dd-aa38-48cbafba8451] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:27.790684 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-4142496e-89d1-4c9a-9633-418f71d8e752 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:27.791670 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-4142496e-89d1-4c9a-9633-418f71d8e752 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:27.795222 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_cell0:SELECT=2 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:44:27.799425 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c3d001f7-e2d7-4e4c-b051-c8215d34bd57 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:27.799904 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c3d001f7-e2d7-4e4c-b051-c8215d34bd57 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:27.800330 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c3d001f7-e2d7-4e4c-b051-c8215d34bd57 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:27.801041 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c3d001f7-e2d7-4e4c-b051-c8215d34bd57 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:27.801211 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4142496e-89d1-4c9a-9633-418f71d8e752 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:27.801523 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c3d001f7-e2d7-4e4c-b051-c8215d34bd57 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:27.801638 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4142496e-89d1-4c9a-9633-418f71d8e752 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:27.801964 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c3d001f7-e2d7-4e4c-b051-c8215d34bd57 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:27.802122 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4142496e-89d1-4c9a-9633-418f71d8e752 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:27.802782 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4142496e-89d1-4c9a-9633-418f71d8e752 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:27.803213 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4142496e-89d1-4c9a-9633-418f71d8e752 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:27.803626 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4142496e-89d1-4c9a-9633-418f71d8e752 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:27.859232 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_cell0:SELECT=12 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:44:27.992563 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-c3d001f7-e2d7-4e4c-b051-c8215d34bd57 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:27.999107 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-4142496e-89d1-4c9a-9633-418f71d8e752 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:28.006724 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-c3d001f7-e2d7-4e4c-b051-c8215d34bd57 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/3cda6c0b-68ff-41dd-aa38-48cbafba8451" status: 200 len: 1365 microversion: 2.1 time: 0.224569 Aug 09 02:44:28.007318 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 254/521] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:44:27 2022] GET /compute/v2.1/servers/3cda6c0b-68ff-41dd-aa38-48cbafba8451 => generated 1365 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:44:28.007673 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-4142496e-89d1-4c9a-9633-418f71d8e752 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:28.009231 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-4142496e-89d1-4c9a-9633-418f71d8e752 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:28.010461 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-4142496e-89d1-4c9a-9633-418f71d8e752 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1722 microversion: 2.20 time: 0.226190 Aug 09 02:44:28.015143 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 268/522] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:44:27 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1722 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:44:28.272093 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-b5928f8d-72b8-4276-af36-b27e8193e27b tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:28.272984 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-b5928f8d-72b8-4276-af36-b27e8193e27b tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:28.279604 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b5928f8d-72b8-4276-af36-b27e8193e27b tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:28.280094 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b5928f8d-72b8-4276-af36-b27e8193e27b tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:28.280508 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b5928f8d-72b8-4276-af36-b27e8193e27b tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:28.281701 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b5928f8d-72b8-4276-af36-b27e8193e27b tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:28.282452 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b5928f8d-72b8-4276-af36-b27e8193e27b tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:28.282888 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b5928f8d-72b8-4276-af36-b27e8193e27b tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:28.420751 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-b5928f8d-72b8-4276-af36-b27e8193e27b tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:28.428429 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-b5928f8d-72b8-4276-af36-b27e8193e27b tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 200 len: 1676 microversion: 2.1 time: 0.160716 Aug 09 02:44:28.428961 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 255/523] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:44:28 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:44:29.031716 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-608e05c8-e007-4c3a-8bcf-cd4efd702d9a tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:29.032341 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-608e05c8-e007-4c3a-8bcf-cd4efd702d9a tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 3cda6c0b-68ff-41dd-aa38-48cbafba8451] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:29.034464 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-9e595d20-5906-448d-8f48-c677727856e8 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:29.035073 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-9e595d20-5906-448d-8f48-c677727856e8 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:29.039125 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-608e05c8-e007-4c3a-8bcf-cd4efd702d9a tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:29.039602 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-608e05c8-e007-4c3a-8bcf-cd4efd702d9a tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:29.040003 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-608e05c8-e007-4c3a-8bcf-cd4efd702d9a tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:29.040713 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-608e05c8-e007-4c3a-8bcf-cd4efd702d9a tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:29.041159 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-608e05c8-e007-4c3a-8bcf-cd4efd702d9a tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:29.041570 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-608e05c8-e007-4c3a-8bcf-cd4efd702d9a tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:29.041977 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9e595d20-5906-448d-8f48-c677727856e8 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:29.042493 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9e595d20-5906-448d-8f48-c677727856e8 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:29.042924 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9e595d20-5906-448d-8f48-c677727856e8 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:29.043610 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9e595d20-5906-448d-8f48-c677727856e8 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:29.044061 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9e595d20-5906-448d-8f48-c677727856e8 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:29.044478 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9e595d20-5906-448d-8f48-c677727856e8 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:29.247393 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-608e05c8-e007-4c3a-8bcf-cd4efd702d9a tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:29.249768 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-9e595d20-5906-448d-8f48-c677727856e8 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:29.258004 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-608e05c8-e007-4c3a-8bcf-cd4efd702d9a tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/3cda6c0b-68ff-41dd-aa38-48cbafba8451" status: 200 len: 1365 microversion: 2.1 time: 0.232291 Aug 09 02:44:29.259281 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 269/524] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:44:29 2022] GET /compute/v2.1/servers/3cda6c0b-68ff-41dd-aa38-48cbafba8451 => generated 1365 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:44:29.270048 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-9e595d20-5906-448d-8f48-c677727856e8 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:29.277048 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-9e595d20-5906-448d-8f48-c677727856e8 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:29.278589 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-9e595d20-5906-448d-8f48-c677727856e8 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1725 microversion: 2.20 time: 0.248648 Aug 09 02:44:29.282971 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [req-a527fcc7-c7fa-4a24-ae65-158294fb79b6 req-3930f0c2-6237-488c-8e45-31ee321c671c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cda6c0b-68ff-41dd-aa38-48cbafba8451", "name": "network-vif-plugged", "status": "completed", "tag": "dd6d3011-7693-4d78-b859-3220bb048c68"}]} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:44:29.290131 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 256/525] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:44:29 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1725 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:44:29.293526 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-a527fcc7-c7fa-4a24-ae65-158294fb79b6 req-3930f0c2-6237-488c-8e45-31ee321c671c service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:29.294001 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-a527fcc7-c7fa-4a24-ae65-158294fb79b6 req-3930f0c2-6237-488c-8e45-31ee321c671c service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:29.294446 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-a527fcc7-c7fa-4a24-ae65-158294fb79b6 req-3930f0c2-6237-488c-8e45-31ee321c671c service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:29.301668 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-63b87652-7228-4320-a0fc-4356cda9f09e tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d9a0ac98-01fb-45fd-a3a0-00fed8f329d3"}} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:44:29.304127 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-63b87652-7228-4320-a0fc-4356cda9f09e tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:29.307851 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.compute.server_external_events [req-a527fcc7-c7fa-4a24-ae65-158294fb79b6 req-3930f0c2-6237-488c-8e45-31ee321c671c service nova] Creating event network-vif-plugged:dd6d3011-7693-4d78-b859-3220bb048c68 for instance 3cda6c0b-68ff-41dd-aa38-48cbafba8451 on hv-cinder-85246 Aug 09 02:44:29.310063 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-63b87652-7228-4320-a0fc-4356cda9f09e tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:29.310654 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-63b87652-7228-4320-a0fc-4356cda9f09e tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:29.312193 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-63b87652-7228-4320-a0fc-4356cda9f09e tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:29.313217 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-63b87652-7228-4320-a0fc-4356cda9f09e tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:29.313529 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [req-a527fcc7-c7fa-4a24-ae65-158294fb79b6 req-3930f0c2-6237-488c-8e45-31ee321c671c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034455 Aug 09 02:44:29.314008 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-63b87652-7228-4320-a0fc-4356cda9f09e tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:29.314307 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 270/526] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:44:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 02:44:29.314563 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-63b87652-7228-4320-a0fc-4356cda9f09e tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:29.452707 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-411a2681-dbe1-437d-8f16-9fe7e77f2810 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:29.453617 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-411a2681-dbe1-437d-8f16-9fe7e77f2810 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:29.461708 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-411a2681-dbe1-437d-8f16-9fe7e77f2810 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:29.462484 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-411a2681-dbe1-437d-8f16-9fe7e77f2810 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:29.463166 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-411a2681-dbe1-437d-8f16-9fe7e77f2810 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:29.464063 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-411a2681-dbe1-437d-8f16-9fe7e77f2810 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:29.465120 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-411a2681-dbe1-437d-8f16-9fe7e77f2810 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:29.465821 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-411a2681-dbe1-437d-8f16-9fe7e77f2810 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:29.643508 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-411a2681-dbe1-437d-8f16-9fe7e77f2810 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:29.647313 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-63b87652-7228-4320-a0fc-4356cda9f09e tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "POST /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.349482 Aug 09 02:44:29.647996 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 257/527] 10.222.0.20 () {62 vars in 1364 bytes} [Tue Aug 9 02:44:29 2022] POST /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73/os-volume_attachments => generated 188 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 02:44:29.652002 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-411a2681-dbe1-437d-8f16-9fe7e77f2810 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 200 len: 1653 microversion: 2.1 time: 0.206176 Aug 09 02:44:29.652579 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 271/528] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:44:29 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 1653 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:44:29.673602 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-ac75a5b1-e039-4d41-8e4f-c3d473e20734 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:44:29.680650 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ac75a5b1-e039-4d41-8e4f-c3d473e20734 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:29.681145 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ac75a5b1-e039-4d41-8e4f-c3d473e20734 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:29.681579 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ac75a5b1-e039-4d41-8e4f-c3d473e20734 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:29.704888 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-ac75a5b1-e039-4d41-8e4f-c3d473e20734 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Going to try to start instance {{(pid=124425) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 09 02:44:29.752402 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-ac75a5b1-e039-4d41-8e4f-c3d473e20734 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "POST /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89/action" status: 202 len: 0 microversion: 2.1 time: 0.082268 Aug 09 02:44:29.753251 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 258/529] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Aug 9 02:44:29 2022] POST /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 02:44:29.762669 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-080cffa7-d4e7-46bc-9ca2-a0b5e824675a tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:29.763411 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-080cffa7-d4e7-46bc-9ca2-a0b5e824675a tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:29.769584 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-080cffa7-d4e7-46bc-9ca2-a0b5e824675a tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:29.770064 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-080cffa7-d4e7-46bc-9ca2-a0b5e824675a tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:29.770541 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-080cffa7-d4e7-46bc-9ca2-a0b5e824675a tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:29.771523 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-080cffa7-d4e7-46bc-9ca2-a0b5e824675a tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:29.772490 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-080cffa7-d4e7-46bc-9ca2-a0b5e824675a tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:29.772920 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-080cffa7-d4e7-46bc-9ca2-a0b5e824675a tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:29.778201 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-565ca272-6cd7-4742-91fd-fc3b59ca9805 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:44:29.778961 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-565ca272-6cd7-4742-91fd-fc3b59ca9805 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:29.785393 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-565ca272-6cd7-4742-91fd-fc3b59ca9805 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:29.785953 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-565ca272-6cd7-4742-91fd-fc3b59ca9805 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:29.786525 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-565ca272-6cd7-4742-91fd-fc3b59ca9805 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:29.787285 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-565ca272-6cd7-4742-91fd-fc3b59ca9805 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:29.787809 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-565ca272-6cd7-4742-91fd-fc3b59ca9805 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:29.788318 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-565ca272-6cd7-4742-91fd-fc3b59ca9805 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:29.832800 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-565ca272-6cd7-4742-91fd-fc3b59ca9805 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124425) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 09 02:44:29.906212 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-565ca272-6cd7-4742-91fd-fc3b59ca9805 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "POST /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73/action" status: 202 len: 0 microversion: 2.20 time: 0.132203 Aug 09 02:44:29.907094 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 259/530] 10.222.0.20 () {62 vars in 1319 bytes} [Tue Aug 9 02:44:29 2022] POST /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 09 02:44:29.915292 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-080cffa7-d4e7-46bc-9ca2-a0b5e824675a tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:29.915665 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-7837b3fc-1131-45eb-b860-37eabf2ca1ff tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:29.916275 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-7837b3fc-1131-45eb-b860-37eabf2ca1ff tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:29.923920 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7837b3fc-1131-45eb-b860-37eabf2ca1ff tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:29.924118 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-080cffa7-d4e7-46bc-9ca2-a0b5e824675a tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 200 len: 1662 microversion: 2.1 time: 0.165316 Aug 09 02:44:29.924788 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 272/531] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:44:29 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 1662 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:44:29.924919 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7837b3fc-1131-45eb-b860-37eabf2ca1ff tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:29.925695 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7837b3fc-1131-45eb-b860-37eabf2ca1ff tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:29.926956 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7837b3fc-1131-45eb-b860-37eabf2ca1ff tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:29.927438 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7837b3fc-1131-45eb-b860-37eabf2ca1ff tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:29.927896 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7837b3fc-1131-45eb-b860-37eabf2ca1ff tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:30.069400 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-7837b3fc-1131-45eb-b860-37eabf2ca1ff tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:30.077954 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-7837b3fc-1131-45eb-b860-37eabf2ca1ff tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:30.079479 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-7837b3fc-1131-45eb-b860-37eabf2ca1ff tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:30.080642 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-7837b3fc-1131-45eb-b860-37eabf2ca1ff tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1751 microversion: 2.20 time: 0.169269 Aug 09 02:44:30.081212 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 260/532] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:44:29 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1751 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:44:30.283171 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-172bd8e7-d8ad-45c7-a9ce-c87de3c478a5 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:30.283968 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-172bd8e7-d8ad-45c7-a9ce-c87de3c478a5 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 3cda6c0b-68ff-41dd-aa38-48cbafba8451] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:30.290845 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-172bd8e7-d8ad-45c7-a9ce-c87de3c478a5 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:30.291325 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-172bd8e7-d8ad-45c7-a9ce-c87de3c478a5 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:30.291749 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-172bd8e7-d8ad-45c7-a9ce-c87de3c478a5 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:30.292415 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-172bd8e7-d8ad-45c7-a9ce-c87de3c478a5 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:30.292888 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-172bd8e7-d8ad-45c7-a9ce-c87de3c478a5 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:30.293306 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-172bd8e7-d8ad-45c7-a9ce-c87de3c478a5 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:30.436373 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-172bd8e7-d8ad-45c7-a9ce-c87de3c478a5 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:30.438831 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_cell1:SELECT=100 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:44:30.445835 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-172bd8e7-d8ad-45c7-a9ce-c87de3c478a5 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/3cda6c0b-68ff-41dd-aa38-48cbafba8451" status: 200 len: 1365 microversion: 2.1 time: 0.166599 Aug 09 02:44:30.446639 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 273/533] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:44:30 2022] GET /compute/v2.1/servers/3cda6c0b-68ff-41dd-aa38-48cbafba8451 => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:44:30.949385 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-e73227b4-afcf-4f8c-97f8-3715363c8815 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:30.950323 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-e73227b4-afcf-4f8c-97f8-3715363c8815 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:30.957552 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e73227b4-afcf-4f8c-97f8-3715363c8815 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:30.958028 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e73227b4-afcf-4f8c-97f8-3715363c8815 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:30.958484 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e73227b4-afcf-4f8c-97f8-3715363c8815 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:30.959162 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e73227b4-afcf-4f8c-97f8-3715363c8815 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:30.959605 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e73227b4-afcf-4f8c-97f8-3715363c8815 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:30.960027 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e73227b4-afcf-4f8c-97f8-3715363c8815 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:30.974821 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=5,nova_cell1:UPDATE=6 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:44:31.095135 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-e73227b4-afcf-4f8c-97f8-3715363c8815 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:31.103046 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-e73227b4-afcf-4f8c-97f8-3715363c8815 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 200 len: 1662 microversion: 2.1 time: 0.160220 Aug 09 02:44:31.103220 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-20396f24-cab7-4655-b265-605401cc2e77 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:31.103863 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 261/534] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:44:30 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 1662 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:44:31.103983 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-20396f24-cab7-4655-b265-605401cc2e77 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:31.110272 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-20396f24-cab7-4655-b265-605401cc2e77 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:31.110777 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-20396f24-cab7-4655-b265-605401cc2e77 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:31.111180 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-20396f24-cab7-4655-b265-605401cc2e77 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:31.111885 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-20396f24-cab7-4655-b265-605401cc2e77 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:31.112330 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-20396f24-cab7-4655-b265-605401cc2e77 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:31.112730 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-20396f24-cab7-4655-b265-605401cc2e77 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:31.263027 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-20396f24-cab7-4655-b265-605401cc2e77 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:31.275629 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-20396f24-cab7-4655-b265-605401cc2e77 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:31.277805 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-20396f24-cab7-4655-b265-605401cc2e77 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:31.279634 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-20396f24-cab7-4655-b265-605401cc2e77 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1751 microversion: 2.20 time: 0.180399 Aug 09 02:44:31.280446 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 274/535] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:44:31 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1751 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 02:44:31.344266 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [req-8720b6e5-b394-405c-91a1-70f39094bdae req-b9b397d4-cc0e-414f-b8f3-3300c00dc6bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9919dd32-c9e0-42ae-8981-414c2e663e73", "name": "network-vif-unplugged", "status": "completed", "tag": "e32a0be8-e008-4397-89d0-66d5a85e0515"}]} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:44:31.350238 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=2,nova_api:UPDATE=2 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:44:31.354673 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-8720b6e5-b394-405c-91a1-70f39094bdae req-b9b397d4-cc0e-414f-b8f3-3300c00dc6bd service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:31.355137 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-8720b6e5-b394-405c-91a1-70f39094bdae req-b9b397d4-cc0e-414f-b8f3-3300c00dc6bd service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:31.355570 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-8720b6e5-b394-405c-91a1-70f39094bdae req-b9b397d4-cc0e-414f-b8f3-3300c00dc6bd service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:31.367415 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.compute.server_external_events [req-8720b6e5-b394-405c-91a1-70f39094bdae req-b9b397d4-cc0e-414f-b8f3-3300c00dc6bd service nova] Unable to find a host for instance 9919dd32-c9e0-42ae-8981-414c2e663e73. Dropping event network-vif-unplugged {{(pid=124425) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 09 02:44:31.368257 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [req-8720b6e5-b394-405c-91a1-70f39094bdae req-b9b397d4-cc0e-414f-b8f3-3300c00dc6bd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028019 Aug 09 02:44:31.368805 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 262/536] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:44:31 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 09 02:44:31.470982 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-61fb278a-6667-424a-8c02-8778acd5c7ae tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:31.471878 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-61fb278a-6667-424a-8c02-8778acd5c7ae tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 3cda6c0b-68ff-41dd-aa38-48cbafba8451] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:31.482917 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-61fb278a-6667-424a-8c02-8778acd5c7ae tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:31.484191 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-61fb278a-6667-424a-8c02-8778acd5c7ae tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:31.484625 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-61fb278a-6667-424a-8c02-8778acd5c7ae tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:31.485322 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-61fb278a-6667-424a-8c02-8778acd5c7ae tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:31.485773 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-61fb278a-6667-424a-8c02-8778acd5c7ae tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:31.486189 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-61fb278a-6667-424a-8c02-8778acd5c7ae tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:31.636239 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-61fb278a-6667-424a-8c02-8778acd5c7ae tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:31.644832 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-61fb278a-6667-424a-8c02-8778acd5c7ae tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/3cda6c0b-68ff-41dd-aa38-48cbafba8451" status: 200 len: 1365 microversion: 2.1 time: 0.180555 Aug 09 02:44:31.645418 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 275/537] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:44:31 2022] GET /compute/v2.1/servers/3cda6c0b-68ff-41dd-aa38-48cbafba8451 => generated 1365 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:44:32.130881 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-5183b4ef-ed2d-4f60-b362-177b4d098a37 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:32.131851 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-5183b4ef-ed2d-4f60-b362-177b4d098a37 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:32.142936 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-5183b4ef-ed2d-4f60-b362-177b4d098a37 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:32.143733 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-5183b4ef-ed2d-4f60-b362-177b4d098a37 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:32.144443 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-5183b4ef-ed2d-4f60-b362-177b4d098a37 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:32.145585 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-5183b4ef-ed2d-4f60-b362-177b4d098a37 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:32.146381 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-5183b4ef-ed2d-4f60-b362-177b4d098a37 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:32.147080 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-5183b4ef-ed2d-4f60-b362-177b4d098a37 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:32.286847 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-5183b4ef-ed2d-4f60-b362-177b4d098a37 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:32.294736 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-5183b4ef-ed2d-4f60-b362-177b4d098a37 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 200 len: 1662 microversion: 2.1 time: 0.171788 Aug 09 02:44:32.295309 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 263/538] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:44:32 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 1662 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:44:32.303358 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-1f6779ae-8f82-4d98-b2a0-9f404f4e300c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:32.304143 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-1f6779ae-8f82-4d98-b2a0-9f404f4e300c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:32.310568 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1f6779ae-8f82-4d98-b2a0-9f404f4e300c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:32.311164 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1f6779ae-8f82-4d98-b2a0-9f404f4e300c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:32.311602 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1f6779ae-8f82-4d98-b2a0-9f404f4e300c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:32.312284 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1f6779ae-8f82-4d98-b2a0-9f404f4e300c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:32.312737 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1f6779ae-8f82-4d98-b2a0-9f404f4e300c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:32.313161 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1f6779ae-8f82-4d98-b2a0-9f404f4e300c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:32.443851 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-1f6779ae-8f82-4d98-b2a0-9f404f4e300c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:32.453026 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-1f6779ae-8f82-4d98-b2a0-9f404f4e300c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:32.454638 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-1f6779ae-8f82-4d98-b2a0-9f404f4e300c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:32.455829 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-1f6779ae-8f82-4d98-b2a0-9f404f4e300c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1753 microversion: 2.20 time: 0.156745 Aug 09 02:44:32.456656 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 276/539] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:44:32 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:44:32.665770 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-10c6a520-74bd-48db-92c0-fee964fc0cdd tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:32.666464 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-10c6a520-74bd-48db-92c0-fee964fc0cdd tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 3cda6c0b-68ff-41dd-aa38-48cbafba8451] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:32.673027 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-10c6a520-74bd-48db-92c0-fee964fc0cdd tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:32.673485 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-10c6a520-74bd-48db-92c0-fee964fc0cdd tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:32.673936 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-10c6a520-74bd-48db-92c0-fee964fc0cdd tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:32.674659 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-10c6a520-74bd-48db-92c0-fee964fc0cdd tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:32.675104 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-10c6a520-74bd-48db-92c0-fee964fc0cdd tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:32.675525 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-10c6a520-74bd-48db-92c0-fee964fc0cdd tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:32.899763 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-10c6a520-74bd-48db-92c0-fee964fc0cdd tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:32.909638 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-10c6a520-74bd-48db-92c0-fee964fc0cdd tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/3cda6c0b-68ff-41dd-aa38-48cbafba8451" status: 200 len: 1555 microversion: 2.1 time: 0.247606 Aug 09 02:44:32.911128 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 264/540] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:44:32 2022] GET /compute/v2.1/servers/3cda6c0b-68ff-41dd-aa38-48cbafba8451 => generated 1555 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:44:32.930538 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-51c42036-7c73-4022-87c8-446ac580631b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:32.931123 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-51c42036-7c73-4022-87c8-446ac580631b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 3cda6c0b-68ff-41dd-aa38-48cbafba8451] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:32.937646 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-51c42036-7c73-4022-87c8-446ac580631b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:32.938288 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-51c42036-7c73-4022-87c8-446ac580631b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:32.938763 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-51c42036-7c73-4022-87c8-446ac580631b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:32.939532 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-51c42036-7c73-4022-87c8-446ac580631b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:32.940219 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-51c42036-7c73-4022-87c8-446ac580631b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:32.940851 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-51c42036-7c73-4022-87c8-446ac580631b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:33.016931 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-f73c0e99-591d-466e-96b5-f9a4b26af47d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:44:33.019324 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-f73c0e99-591d-466e-96b5-f9a4b26af47d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: b9369cf3-95d7-41d2-8157-ca2c165b062d] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:33.025378 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f73c0e99-591d-466e-96b5-f9a4b26af47d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:33.026288 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f73c0e99-591d-466e-96b5-f9a4b26af47d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:33.026725 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f73c0e99-591d-466e-96b5-f9a4b26af47d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:33.027786 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f73c0e99-591d-466e-96b5-f9a4b26af47d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:33.028242 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f73c0e99-591d-466e-96b5-f9a4b26af47d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:33.028666 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f73c0e99-591d-466e-96b5-f9a4b26af47d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:33.029351 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-51c42036-7c73-4022-87c8-446ac580631b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/3cda6c0b-68ff-41dd-aa38-48cbafba8451/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102585 Aug 09 02:44:33.029955 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 277/541] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Aug 9 02:44:32 2022] GET /compute/v2.1/servers/3cda6c0b-68ff-41dd-aa38-48cbafba8451/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:44:33.053684 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.objects.instance [None req-f73c0e99-591d-466e-96b5-f9a4b26af47d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lazy-loading 'flavor' on Instance uuid b9369cf3-95d7-41d2-8157-ca2c165b062d {{(pid=124425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 02:44:33.187138 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-f73c0e99-591d-466e-96b5-f9a4b26af47d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "POST /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d/action" status: 200 len: 32 microversion: 2.1 time: 0.174095 Aug 09 02:44:33.188729 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 265/542] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Aug 9 02:44:33 2022] POST /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d/action => generated 32 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 09 02:44:33.198371 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-ed0a49b1-ec3d-4812-9c92-ac9a3fa81962 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:33.198980 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-ed0a49b1-ec3d-4812-9c92-ac9a3fa81962 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: b9369cf3-95d7-41d2-8157-ca2c165b062d] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:33.205335 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ed0a49b1-ec3d-4812-9c92-ac9a3fa81962 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:33.206058 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ed0a49b1-ec3d-4812-9c92-ac9a3fa81962 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:33.206700 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ed0a49b1-ec3d-4812-9c92-ac9a3fa81962 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:33.207570 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ed0a49b1-ec3d-4812-9c92-ac9a3fa81962 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:33.208163 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ed0a49b1-ec3d-4812-9c92-ac9a3fa81962 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:33.208956 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ed0a49b1-ec3d-4812-9c92-ac9a3fa81962 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:33.317627 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-f0f002e3-f05b-4d71-8ccb-a07b7d516c90 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:33.318400 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-f0f002e3-f05b-4d71-8ccb-a07b7d516c90 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:33.325075 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f0f002e3-f05b-4d71-8ccb-a07b7d516c90 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:33.325587 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f0f002e3-f05b-4d71-8ccb-a07b7d516c90 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:33.326021 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f0f002e3-f05b-4d71-8ccb-a07b7d516c90 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:33.326808 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f0f002e3-f05b-4d71-8ccb-a07b7d516c90 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:33.327262 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f0f002e3-f05b-4d71-8ccb-a07b7d516c90 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:33.327655 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f0f002e3-f05b-4d71-8ccb-a07b7d516c90 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:33.548175 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-ed0a49b1-ec3d-4812-9c92-ac9a3fa81962 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:33.556401 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-ed0a49b1-ec3d-4812-9c92-ac9a3fa81962 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d" status: 200 len: 1734 microversion: 2.1 time: 0.361913 Aug 09 02:44:33.556945 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 278/543] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:44:33 2022] GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d => generated 1734 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:44:33.562219 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-2fab4575-306c-47e9-ba4d-ebbfc25360a0 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:33.563058 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-2fab4575-306c-47e9-ba4d-ebbfc25360a0 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:33.569033 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2fab4575-306c-47e9-ba4d-ebbfc25360a0 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:33.569500 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2fab4575-306c-47e9-ba4d-ebbfc25360a0 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:33.569943 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2fab4575-306c-47e9-ba4d-ebbfc25360a0 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:33.570655 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2fab4575-306c-47e9-ba4d-ebbfc25360a0 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:33.571087 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2fab4575-306c-47e9-ba4d-ebbfc25360a0 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:33.571506 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2fab4575-306c-47e9-ba4d-ebbfc25360a0 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:33.628647 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-f0f002e3-f05b-4d71-8ccb-a07b7d516c90 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:33.637709 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-f0f002e3-f05b-4d71-8ccb-a07b7d516c90 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 200 len: 1662 microversion: 2.1 time: 0.324294 Aug 09 02:44:33.638478 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 266/544] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:44:33 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 1662 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:44:33.781871 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-2fab4575-306c-47e9-ba4d-ebbfc25360a0 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:33.792178 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-2fab4575-306c-47e9-ba4d-ebbfc25360a0 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:33.793745 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-2fab4575-306c-47e9-ba4d-ebbfc25360a0 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:33.794936 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-2fab4575-306c-47e9-ba4d-ebbfc25360a0 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1753 microversion: 2.20 time: 0.236490 Aug 09 02:44:33.795498 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 279/545] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:44:33 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1753 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:44:34.577321 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-292dd1e0-228a-439f-bd58-32c48d60c3a3 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:34.578098 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-292dd1e0-228a-439f-bd58-32c48d60c3a3 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: b9369cf3-95d7-41d2-8157-ca2c165b062d] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:34.585764 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-292dd1e0-228a-439f-bd58-32c48d60c3a3 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:34.586760 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-292dd1e0-228a-439f-bd58-32c48d60c3a3 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:34.587429 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-292dd1e0-228a-439f-bd58-32c48d60c3a3 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:34.588572 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-292dd1e0-228a-439f-bd58-32c48d60c3a3 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:34.589852 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-292dd1e0-228a-439f-bd58-32c48d60c3a3 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:34.590316 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-292dd1e0-228a-439f-bd58-32c48d60c3a3 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:34.599411 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [req-a5461ac6-990f-43b8-814b-43f692e59fa8 req-5ca2ad81-4102-4955-9be8-476a15958c15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cda6c0b-68ff-41dd-aa38-48cbafba8451", "tag": "dd6d3011-7693-4d78-b859-3220bb048c68"}]} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:44:34.613553 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-a5461ac6-990f-43b8-814b-43f692e59fa8 req-5ca2ad81-4102-4955-9be8-476a15958c15 service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:34.615129 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-a5461ac6-990f-43b8-814b-43f692e59fa8 req-5ca2ad81-4102-4955-9be8-476a15958c15 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:34.616072 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-a5461ac6-990f-43b8-814b-43f692e59fa8 req-5ca2ad81-4102-4955-9be8-476a15958c15 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:34.631401 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.compute.server_external_events [req-a5461ac6-990f-43b8-814b-43f692e59fa8 req-5ca2ad81-4102-4955-9be8-476a15958c15 service nova] Creating event network-changed:dd6d3011-7693-4d78-b859-3220bb048c68 for instance 3cda6c0b-68ff-41dd-aa38-48cbafba8451 on hv-cinder-85246 Aug 09 02:44:34.637587 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [req-a5461ac6-990f-43b8-814b-43f692e59fa8 req-5ca2ad81-4102-4955-9be8-476a15958c15 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042518 Aug 09 02:44:34.638882 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 280/546] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:44:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:44:34.661767 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-d2e9dab4-7a05-44bc-8896-be45fc1f6c29 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:34.662579 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-d2e9dab4-7a05-44bc-8896-be45fc1f6c29 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:34.677451 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d2e9dab4-7a05-44bc-8896-be45fc1f6c29 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:34.678048 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d2e9dab4-7a05-44bc-8896-be45fc1f6c29 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:34.679674 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d2e9dab4-7a05-44bc-8896-be45fc1f6c29 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:34.680327 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d2e9dab4-7a05-44bc-8896-be45fc1f6c29 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:34.681311 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d2e9dab4-7a05-44bc-8896-be45fc1f6c29 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:34.681311 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d2e9dab4-7a05-44bc-8896-be45fc1f6c29 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:34.800007 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-292dd1e0-228a-439f-bd58-32c48d60c3a3 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:34.808397 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-292dd1e0-228a-439f-bd58-32c48d60c3a3 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d" status: 200 len: 1734 microversion: 2.1 time: 0.234970 Aug 09 02:44:34.809143 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 267/547] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:44:34 2022] GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d => generated 1734 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:44:34.825271 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-9d5741fd-7b89-4199-b7de-dc6e22fdd9bd tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:34.826900 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-9d5741fd-7b89-4199-b7de-dc6e22fdd9bd tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:34.834140 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9d5741fd-7b89-4199-b7de-dc6e22fdd9bd tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:34.834743 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9d5741fd-7b89-4199-b7de-dc6e22fdd9bd tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:34.835716 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9d5741fd-7b89-4199-b7de-dc6e22fdd9bd tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:34.836925 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9d5741fd-7b89-4199-b7de-dc6e22fdd9bd tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:34.836925 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9d5741fd-7b89-4199-b7de-dc6e22fdd9bd tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:34.837478 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9d5741fd-7b89-4199-b7de-dc6e22fdd9bd tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:34.845794 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-d2e9dab4-7a05-44bc-8896-be45fc1f6c29 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:34.852904 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-d2e9dab4-7a05-44bc-8896-be45fc1f6c29 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 200 len: 1666 microversion: 2.1 time: 0.197506 Aug 09 02:44:34.853473 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 281/548] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:44:34 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 1666 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:44:34.971031 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-9d5741fd-7b89-4199-b7de-dc6e22fdd9bd tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:34.980267 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-9d5741fd-7b89-4199-b7de-dc6e22fdd9bd tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:34.981995 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-9d5741fd-7b89-4199-b7de-dc6e22fdd9bd tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:34.983200 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-9d5741fd-7b89-4199-b7de-dc6e22fdd9bd tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1809 microversion: 2.20 time: 0.162941 Aug 09 02:44:34.984267 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 268/549] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:44:34 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 02:44:35.833283 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-9cfe1844-b1eb-49fa-9c58-a826c045ffa3 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:35.833945 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-9cfe1844-b1eb-49fa-9c58-a826c045ffa3 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: b9369cf3-95d7-41d2-8157-ca2c165b062d] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:35.841601 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9cfe1844-b1eb-49fa-9c58-a826c045ffa3 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:35.842205 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9cfe1844-b1eb-49fa-9c58-a826c045ffa3 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:35.842767 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9cfe1844-b1eb-49fa-9c58-a826c045ffa3 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:35.843668 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9cfe1844-b1eb-49fa-9c58-a826c045ffa3 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:35.844125 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9cfe1844-b1eb-49fa-9c58-a826c045ffa3 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:35.844889 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9cfe1844-b1eb-49fa-9c58-a826c045ffa3 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:35.987527 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-9cfe1844-b1eb-49fa-9c58-a826c045ffa3 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:35.996175 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-9cfe1844-b1eb-49fa-9c58-a826c045ffa3 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d" status: 200 len: 1734 microversion: 2.1 time: 0.167200 Aug 09 02:44:35.996750 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 282/550] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:44:35 2022] GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d => generated 1734 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:44:36.006597 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-e5193c84-bb14-4904-83a2-3b0f4793f18a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:36.007214 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-e5193c84-bb14-4904-83a2-3b0f4793f18a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:36.013626 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e5193c84-bb14-4904-83a2-3b0f4793f18a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:36.014091 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e5193c84-bb14-4904-83a2-3b0f4793f18a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:36.014551 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e5193c84-bb14-4904-83a2-3b0f4793f18a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:36.015336 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e5193c84-bb14-4904-83a2-3b0f4793f18a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:36.015783 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e5193c84-bb14-4904-83a2-3b0f4793f18a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:36.016247 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e5193c84-bb14-4904-83a2-3b0f4793f18a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:36.147510 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-e5193c84-bb14-4904-83a2-3b0f4793f18a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:36.156340 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-e5193c84-bb14-4904-83a2-3b0f4793f18a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:36.157979 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-e5193c84-bb14-4904-83a2-3b0f4793f18a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:36.159271 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-e5193c84-bb14-4904-83a2-3b0f4793f18a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1809 microversion: 2.20 time: 0.156623 Aug 09 02:44:36.159934 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 269/551] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:44:36 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:44:37.017525 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-1722f363-a93c-4d90-94ba-f296d424026f tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:37.018101 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-1722f363-a93c-4d90-94ba-f296d424026f tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: b9369cf3-95d7-41d2-8157-ca2c165b062d] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:37.025108 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1722f363-a93c-4d90-94ba-f296d424026f tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:37.025594 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1722f363-a93c-4d90-94ba-f296d424026f tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:37.026024 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1722f363-a93c-4d90-94ba-f296d424026f tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:37.026744 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1722f363-a93c-4d90-94ba-f296d424026f tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:37.027195 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1722f363-a93c-4d90-94ba-f296d424026f tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:37.027613 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1722f363-a93c-4d90-94ba-f296d424026f tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:37.170127 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-1722f363-a93c-4d90-94ba-f296d424026f tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:37.180587 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-1722f363-a93c-4d90-94ba-f296d424026f tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d" status: 200 len: 1734 microversion: 2.1 time: 0.167036 Aug 09 02:44:37.181386 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 283/552] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:44:37 2022] GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:44:37.182821 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-65f5c383-158c-4a2b-b310-7d2c403fea96 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:37.184051 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-65f5c383-158c-4a2b-b310-7d2c403fea96 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:37.191507 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-65f5c383-158c-4a2b-b310-7d2c403fea96 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:37.192305 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-65f5c383-158c-4a2b-b310-7d2c403fea96 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:37.192946 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-65f5c383-158c-4a2b-b310-7d2c403fea96 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:37.193891 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-65f5c383-158c-4a2b-b310-7d2c403fea96 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:37.194587 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-65f5c383-158c-4a2b-b310-7d2c403fea96 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:37.195128 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-65f5c383-158c-4a2b-b310-7d2c403fea96 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:37.335306 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-65f5c383-158c-4a2b-b310-7d2c403fea96 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:37.344488 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-65f5c383-158c-4a2b-b310-7d2c403fea96 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:37.346072 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-65f5c383-158c-4a2b-b310-7d2c403fea96 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:37.347292 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-65f5c383-158c-4a2b-b310-7d2c403fea96 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1809 microversion: 2.20 time: 0.168590 Aug 09 02:44:37.347864 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 270/553] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:44:37 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 02:44:38.203016 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-4a79a8c4-186f-4c04-8431-15510c5f2d3e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:38.203770 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-4a79a8c4-186f-4c04-8431-15510c5f2d3e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: b9369cf3-95d7-41d2-8157-ca2c165b062d] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:38.210733 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4a79a8c4-186f-4c04-8431-15510c5f2d3e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:38.211215 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4a79a8c4-186f-4c04-8431-15510c5f2d3e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:38.211639 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4a79a8c4-186f-4c04-8431-15510c5f2d3e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:38.212319 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4a79a8c4-186f-4c04-8431-15510c5f2d3e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:38.212762 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4a79a8c4-186f-4c04-8431-15510c5f2d3e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:38.213152 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4a79a8c4-186f-4c04-8431-15510c5f2d3e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:38.356987 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-4a79a8c4-186f-4c04-8431-15510c5f2d3e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:38.370726 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-7dad47e6-79e7-4f46-99f3-06ac0ae00db2 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:38.371512 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-7dad47e6-79e7-4f46-99f3-06ac0ae00db2 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:38.377198 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-4a79a8c4-186f-4c04-8431-15510c5f2d3e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d" status: 200 len: 1734 microversion: 2.1 time: 0.178009 Aug 09 02:44:38.378018 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 284/554] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:44:38 2022] GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d => generated 1734 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:44:38.379346 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7dad47e6-79e7-4f46-99f3-06ac0ae00db2 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:38.380084 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7dad47e6-79e7-4f46-99f3-06ac0ae00db2 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:38.380728 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7dad47e6-79e7-4f46-99f3-06ac0ae00db2 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:38.381634 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7dad47e6-79e7-4f46-99f3-06ac0ae00db2 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:38.382319 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7dad47e6-79e7-4f46-99f3-06ac0ae00db2 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:38.382944 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7dad47e6-79e7-4f46-99f3-06ac0ae00db2 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:38.554529 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-7dad47e6-79e7-4f46-99f3-06ac0ae00db2 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:38.563095 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-7dad47e6-79e7-4f46-99f3-06ac0ae00db2 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:38.564655 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-7dad47e6-79e7-4f46-99f3-06ac0ae00db2 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:38.565809 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-7dad47e6-79e7-4f46-99f3-06ac0ae00db2 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1809 microversion: 2.20 time: 0.199025 Aug 09 02:44:38.566416 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 271/555] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:44:38 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1809 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 02:44:39.398615 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-3b2ee680-91d5-4b02-b5b9-6e2837ad75ae tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:39.399392 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-3b2ee680-91d5-4b02-b5b9-6e2837ad75ae tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: b9369cf3-95d7-41d2-8157-ca2c165b062d] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:39.406234 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3b2ee680-91d5-4b02-b5b9-6e2837ad75ae tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:39.406709 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3b2ee680-91d5-4b02-b5b9-6e2837ad75ae tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:39.407149 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3b2ee680-91d5-4b02-b5b9-6e2837ad75ae tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:39.407843 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3b2ee680-91d5-4b02-b5b9-6e2837ad75ae tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:39.408289 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3b2ee680-91d5-4b02-b5b9-6e2837ad75ae tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:39.408701 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3b2ee680-91d5-4b02-b5b9-6e2837ad75ae tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:39.547162 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-3b2ee680-91d5-4b02-b5b9-6e2837ad75ae tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:39.555378 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-3b2ee680-91d5-4b02-b5b9-6e2837ad75ae tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d" status: 200 len: 1734 microversion: 2.1 time: 0.160816 Aug 09 02:44:39.555958 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 285/556] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:44:39 2022] GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:44:39.588716 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-f853384a-080b-4f3d-b4b7-33ae9fb994a7 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:39.590209 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-f853384a-080b-4f3d-b4b7-33ae9fb994a7 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:39.598002 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f853384a-080b-4f3d-b4b7-33ae9fb994a7 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:39.598797 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f853384a-080b-4f3d-b4b7-33ae9fb994a7 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:39.599388 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f853384a-080b-4f3d-b4b7-33ae9fb994a7 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:39.600408 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f853384a-080b-4f3d-b4b7-33ae9fb994a7 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:39.601073 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f853384a-080b-4f3d-b4b7-33ae9fb994a7 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:39.601641 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f853384a-080b-4f3d-b4b7-33ae9fb994a7 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:39.757692 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-f853384a-080b-4f3d-b4b7-33ae9fb994a7 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:39.767556 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-f853384a-080b-4f3d-b4b7-33ae9fb994a7 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:39.769130 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-f853384a-080b-4f3d-b4b7-33ae9fb994a7 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:39.770353 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-f853384a-080b-4f3d-b4b7-33ae9fb994a7 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1809 microversion: 2.20 time: 0.185675 Aug 09 02:44:39.771121 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 272/557] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:44:39 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1809 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:44:40.581507 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-64b835a6-45a1-4c86-9477-a3f4fdefe161 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:40.582222 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-64b835a6-45a1-4c86-9477-a3f4fdefe161 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: b9369cf3-95d7-41d2-8157-ca2c165b062d] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:40.589629 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-64b835a6-45a1-4c86-9477-a3f4fdefe161 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:40.590125 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-64b835a6-45a1-4c86-9477-a3f4fdefe161 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:40.590587 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-64b835a6-45a1-4c86-9477-a3f4fdefe161 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:40.591292 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-64b835a6-45a1-4c86-9477-a3f4fdefe161 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:40.591744 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-64b835a6-45a1-4c86-9477-a3f4fdefe161 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:40.592162 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-64b835a6-45a1-4c86-9477-a3f4fdefe161 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:40.729388 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-64b835a6-45a1-4c86-9477-a3f4fdefe161 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:40.738818 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-64b835a6-45a1-4c86-9477-a3f4fdefe161 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d" status: 200 len: 1734 microversion: 2.1 time: 0.164271 Aug 09 02:44:40.757725 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 286/558] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:44:40 2022] GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d => generated 1734 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:44:40.793926 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-e12f8a40-1496-4f01-8def-66c671f8ef25 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:40.794575 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-e12f8a40-1496-4f01-8def-66c671f8ef25 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:40.801240 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e12f8a40-1496-4f01-8def-66c671f8ef25 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:40.801729 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e12f8a40-1496-4f01-8def-66c671f8ef25 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:40.802175 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e12f8a40-1496-4f01-8def-66c671f8ef25 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:40.802876 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e12f8a40-1496-4f01-8def-66c671f8ef25 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:40.803323 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e12f8a40-1496-4f01-8def-66c671f8ef25 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:40.803742 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e12f8a40-1496-4f01-8def-66c671f8ef25 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:40.954911 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-e12f8a40-1496-4f01-8def-66c671f8ef25 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:40.963487 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-e12f8a40-1496-4f01-8def-66c671f8ef25 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:40.965034 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-e12f8a40-1496-4f01-8def-66c671f8ef25 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:40.966269 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-e12f8a40-1496-4f01-8def-66c671f8ef25 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1809 microversion: 2.20 time: 0.176267 Aug 09 02:44:40.967155 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 273/559] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:44:40 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:44:41.765578 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-cb54a153-cb1f-4734-ac36-b739e029e4e0 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:41.766175 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-cb54a153-cb1f-4734-ac36-b739e029e4e0 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: b9369cf3-95d7-41d2-8157-ca2c165b062d] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:41.772688 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-cb54a153-cb1f-4734-ac36-b739e029e4e0 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:41.773169 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-cb54a153-cb1f-4734-ac36-b739e029e4e0 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:41.773598 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-cb54a153-cb1f-4734-ac36-b739e029e4e0 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:41.774339 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-cb54a153-cb1f-4734-ac36-b739e029e4e0 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:41.774821 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-cb54a153-cb1f-4734-ac36-b739e029e4e0 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:41.775181 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-cb54a153-cb1f-4734-ac36-b739e029e4e0 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:41.911098 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-cb54a153-cb1f-4734-ac36-b739e029e4e0 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:41.919431 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-cb54a153-cb1f-4734-ac36-b739e029e4e0 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d" status: 200 len: 1734 microversion: 2.1 time: 0.158000 Aug 09 02:44:41.919994 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 287/560] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:44:41 2022] GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:44:41.992744 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-19eac21a-7c34-469f-a91a-102645e8c203 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:41.993756 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-19eac21a-7c34-469f-a91a-102645e8c203 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:42.004228 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-19eac21a-7c34-469f-a91a-102645e8c203 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:42.005018 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-19eac21a-7c34-469f-a91a-102645e8c203 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:42.005734 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-19eac21a-7c34-469f-a91a-102645e8c203 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:42.006917 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-19eac21a-7c34-469f-a91a-102645e8c203 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:42.007663 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-19eac21a-7c34-469f-a91a-102645e8c203 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:42.008348 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-19eac21a-7c34-469f-a91a-102645e8c203 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:42.147183 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-19eac21a-7c34-469f-a91a-102645e8c203 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:42.155992 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-19eac21a-7c34-469f-a91a-102645e8c203 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:42.157489 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-19eac21a-7c34-469f-a91a-102645e8c203 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:42.158730 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-19eac21a-7c34-469f-a91a-102645e8c203 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1809 microversion: 2.20 time: 0.172129 Aug 09 02:44:42.159279 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 274/561] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:44:41 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:44:42.942864 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-6889bedb-de7c-4420-b36e-edac0db823a6 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:42.943799 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-6889bedb-de7c-4420-b36e-edac0db823a6 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: b9369cf3-95d7-41d2-8157-ca2c165b062d] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:42.950913 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6889bedb-de7c-4420-b36e-edac0db823a6 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:42.951392 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6889bedb-de7c-4420-b36e-edac0db823a6 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:42.951818 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6889bedb-de7c-4420-b36e-edac0db823a6 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:42.952542 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6889bedb-de7c-4420-b36e-edac0db823a6 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:42.953022 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6889bedb-de7c-4420-b36e-edac0db823a6 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:42.953466 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6889bedb-de7c-4420-b36e-edac0db823a6 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:43.097289 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-6889bedb-de7c-4420-b36e-edac0db823a6 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:43.105308 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-6889bedb-de7c-4420-b36e-edac0db823a6 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d" status: 200 len: 1734 microversion: 2.1 time: 0.167746 Aug 09 02:44:43.105882 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 288/562] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:44:42 2022] GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:44:43.185059 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-95f14660-702c-4f94-bb81-e501794031ca tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:43.185822 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-95f14660-702c-4f94-bb81-e501794031ca tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:43.194255 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-95f14660-702c-4f94-bb81-e501794031ca tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:43.194800 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-95f14660-702c-4f94-bb81-e501794031ca tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:43.195254 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-95f14660-702c-4f94-bb81-e501794031ca tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:43.195986 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-95f14660-702c-4f94-bb81-e501794031ca tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:43.196446 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-95f14660-702c-4f94-bb81-e501794031ca tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:43.198201 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-95f14660-702c-4f94-bb81-e501794031ca tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:43.333622 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-95f14660-702c-4f94-bb81-e501794031ca tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:43.347536 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-95f14660-702c-4f94-bb81-e501794031ca tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:43.349024 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-95f14660-702c-4f94-bb81-e501794031ca tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:43.350196 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-95f14660-702c-4f94-bb81-e501794031ca tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1809 microversion: 2.20 time: 0.171159 Aug 09 02:44:43.350754 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 275/563] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:44:43 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:44:44.126978 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-fb004cd2-6365-416e-bec5-f3161ad0323b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:44.127716 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-fb004cd2-6365-416e-bec5-f3161ad0323b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: b9369cf3-95d7-41d2-8157-ca2c165b062d] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:44.134310 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-fb004cd2-6365-416e-bec5-f3161ad0323b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:44.134790 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-fb004cd2-6365-416e-bec5-f3161ad0323b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:44.135220 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-fb004cd2-6365-416e-bec5-f3161ad0323b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:44.135879 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-fb004cd2-6365-416e-bec5-f3161ad0323b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:44.136355 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-fb004cd2-6365-416e-bec5-f3161ad0323b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:44.136774 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-fb004cd2-6365-416e-bec5-f3161ad0323b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:44.275357 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-fb004cd2-6365-416e-bec5-f3161ad0323b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:44.283997 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-fb004cd2-6365-416e-bec5-f3161ad0323b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d" status: 200 len: 1734 microversion: 2.1 time: 0.160846 Aug 09 02:44:44.284586 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 289/564] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:44:44 2022] GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:44:44.377179 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-f23667d1-58b0-4134-a4be-39c0b1aec5ef tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:44.378613 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-f23667d1-58b0-4134-a4be-39c0b1aec5ef tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:44.390659 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f23667d1-58b0-4134-a4be-39c0b1aec5ef tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:44.392314 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f23667d1-58b0-4134-a4be-39c0b1aec5ef tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:44.393452 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f23667d1-58b0-4134-a4be-39c0b1aec5ef tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:44.394569 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f23667d1-58b0-4134-a4be-39c0b1aec5ef tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:44.395079 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f23667d1-58b0-4134-a4be-39c0b1aec5ef tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:44.395581 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f23667d1-58b0-4134-a4be-39c0b1aec5ef tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:44.543884 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-f23667d1-58b0-4134-a4be-39c0b1aec5ef tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:44.546234 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:44:44.554094 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-f23667d1-58b0-4134-a4be-39c0b1aec5ef tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:44.555696 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-f23667d1-58b0-4134-a4be-39c0b1aec5ef tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:44.557128 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-f23667d1-58b0-4134-a4be-39c0b1aec5ef tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1809 microversion: 2.20 time: 0.187699 Aug 09 02:44:44.557895 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 276/565] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:44:44 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1809 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:44:45.307621 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-5377666d-1abf-4aa3-9619-daffd625026d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:45.309110 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-5377666d-1abf-4aa3-9619-daffd625026d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: b9369cf3-95d7-41d2-8157-ca2c165b062d] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:45.317970 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5377666d-1abf-4aa3-9619-daffd625026d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:45.318491 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5377666d-1abf-4aa3-9619-daffd625026d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:45.318924 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5377666d-1abf-4aa3-9619-daffd625026d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:45.319622 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5377666d-1abf-4aa3-9619-daffd625026d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:45.320071 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5377666d-1abf-4aa3-9619-daffd625026d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:45.320494 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5377666d-1abf-4aa3-9619-daffd625026d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:45.455670 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-5377666d-1abf-4aa3-9619-daffd625026d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:45.464077 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-5377666d-1abf-4aa3-9619-daffd625026d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d" status: 200 len: 1734 microversion: 2.1 time: 0.162537 Aug 09 02:44:45.464652 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 290/566] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:44:45 2022] GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:44:45.582798 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-c0cd2bb7-a4e0-443d-8f1c-e978b647603b tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:45.583527 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-c0cd2bb7-a4e0-443d-8f1c-e978b647603b tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:45.590693 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c0cd2bb7-a4e0-443d-8f1c-e978b647603b tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:45.591182 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c0cd2bb7-a4e0-443d-8f1c-e978b647603b tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:45.591611 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c0cd2bb7-a4e0-443d-8f1c-e978b647603b tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:45.592285 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c0cd2bb7-a4e0-443d-8f1c-e978b647603b tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:45.592744 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c0cd2bb7-a4e0-443d-8f1c-e978b647603b tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:45.593162 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c0cd2bb7-a4e0-443d-8f1c-e978b647603b tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:45.736539 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-c0cd2bb7-a4e0-443d-8f1c-e978b647603b tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:45.745114 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-c0cd2bb7-a4e0-443d-8f1c-e978b647603b tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:45.746623 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-c0cd2bb7-a4e0-443d-8f1c-e978b647603b tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:45.747847 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-c0cd2bb7-a4e0-443d-8f1c-e978b647603b tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1809 microversion: 2.20 time: 0.169956 Aug 09 02:44:45.748401 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 277/567] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:44:45 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:44:46.486057 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-a50a61c8-08b3-4469-93c3-0fb43c1865f9 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:46.486644 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-a50a61c8-08b3-4469-93c3-0fb43c1865f9 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: b9369cf3-95d7-41d2-8157-ca2c165b062d] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:46.493353 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a50a61c8-08b3-4469-93c3-0fb43c1865f9 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:46.493835 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a50a61c8-08b3-4469-93c3-0fb43c1865f9 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:46.494306 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a50a61c8-08b3-4469-93c3-0fb43c1865f9 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:46.494988 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a50a61c8-08b3-4469-93c3-0fb43c1865f9 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:46.495431 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a50a61c8-08b3-4469-93c3-0fb43c1865f9 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:46.495849 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a50a61c8-08b3-4469-93c3-0fb43c1865f9 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:46.510611 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_cell1:SELECT=100 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:44:46.629812 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-a50a61c8-08b3-4469-93c3-0fb43c1865f9 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:46.638082 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-a50a61c8-08b3-4469-93c3-0fb43c1865f9 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d" status: 200 len: 1734 microversion: 2.1 time: 0.156398 Aug 09 02:44:46.638689 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 291/568] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:44:46 2022] GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:44:46.771118 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-37d824c0-2616-4b4b-a03a-d089389c5997 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:46.771723 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-37d824c0-2616-4b4b-a03a-d089389c5997 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:46.778729 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-37d824c0-2616-4b4b-a03a-d089389c5997 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:46.779204 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-37d824c0-2616-4b4b-a03a-d089389c5997 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:46.779631 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-37d824c0-2616-4b4b-a03a-d089389c5997 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:46.780306 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-37d824c0-2616-4b4b-a03a-d089389c5997 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:46.780743 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-37d824c0-2616-4b4b-a03a-d089389c5997 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:46.781186 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-37d824c0-2616-4b4b-a03a-d089389c5997 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:46.923766 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-37d824c0-2616-4b4b-a03a-d089389c5997 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:46.936697 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-37d824c0-2616-4b4b-a03a-d089389c5997 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:46.939136 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-37d824c0-2616-4b4b-a03a-d089389c5997 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:46.940727 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-37d824c0-2616-4b4b-a03a-d089389c5997 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1809 microversion: 2.20 time: 0.173369 Aug 09 02:44:46.941455 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 278/569] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:44:46 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:44:47.663425 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-a5843df9-6c35-45d0-bcf7-ec653a773d3c tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:47.664046 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-a5843df9-6c35-45d0-bcf7-ec653a773d3c tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: b9369cf3-95d7-41d2-8157-ca2c165b062d] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:47.671105 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a5843df9-6c35-45d0-bcf7-ec653a773d3c tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:47.671477 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a5843df9-6c35-45d0-bcf7-ec653a773d3c tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:47.671929 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a5843df9-6c35-45d0-bcf7-ec653a773d3c tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:47.672612 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a5843df9-6c35-45d0-bcf7-ec653a773d3c tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:47.673056 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a5843df9-6c35-45d0-bcf7-ec653a773d3c tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:47.673827 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a5843df9-6c35-45d0-bcf7-ec653a773d3c tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:47.807027 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-a5843df9-6c35-45d0-bcf7-ec653a773d3c tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:47.815133 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-a5843df9-6c35-45d0-bcf7-ec653a773d3c tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d" status: 200 len: 1734 microversion: 2.1 time: 0.158262 Aug 09 02:44:47.815718 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 292/570] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:44:47 2022] GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:44:47.969038 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-1d517b1d-f89b-4620-9e05-ac5a216543e6 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:47.969907 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-1d517b1d-f89b-4620-9e05-ac5a216543e6 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:47.980673 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1d517b1d-f89b-4620-9e05-ac5a216543e6 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:47.981460 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1d517b1d-f89b-4620-9e05-ac5a216543e6 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:47.982242 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1d517b1d-f89b-4620-9e05-ac5a216543e6 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:47.983361 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1d517b1d-f89b-4620-9e05-ac5a216543e6 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:47.984490 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1d517b1d-f89b-4620-9e05-ac5a216543e6 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:47.985179 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1d517b1d-f89b-4620-9e05-ac5a216543e6 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:48.118791 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-1d517b1d-f89b-4620-9e05-ac5a216543e6 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:48.130474 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-1d517b1d-f89b-4620-9e05-ac5a216543e6 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:48.132825 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-1d517b1d-f89b-4620-9e05-ac5a216543e6 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:48.134332 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-1d517b1d-f89b-4620-9e05-ac5a216543e6 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1809 microversion: 2.20 time: 0.171711 Aug 09 02:44:48.135100 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 279/571] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:44:47 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:44:48.839616 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-ad1a1119-b467-497b-904b-3919e2c83bf4 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:48.840511 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-ad1a1119-b467-497b-904b-3919e2c83bf4 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: b9369cf3-95d7-41d2-8157-ca2c165b062d] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:48.844130 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:44:48.852475 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ad1a1119-b467-497b-904b-3919e2c83bf4 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:48.853229 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ad1a1119-b467-497b-904b-3919e2c83bf4 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:48.853881 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ad1a1119-b467-497b-904b-3919e2c83bf4 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:48.854959 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ad1a1119-b467-497b-904b-3919e2c83bf4 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:48.855681 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ad1a1119-b467-497b-904b-3919e2c83bf4 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:48.856317 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ad1a1119-b467-497b-904b-3919e2c83bf4 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:49.008797 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-ad1a1119-b467-497b-904b-3919e2c83bf4 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:49.017380 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-ad1a1119-b467-497b-904b-3919e2c83bf4 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d" status: 200 len: 1734 microversion: 2.1 time: 0.183965 Aug 09 02:44:49.017946 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 293/572] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:44:48 2022] GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d => generated 1734 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:44:49.164282 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-ad8af0b8-4a0b-48fe-8ee2-ef9c74aa1498 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:49.164943 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-ad8af0b8-4a0b-48fe-8ee2-ef9c74aa1498 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:49.173391 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ad8af0b8-4a0b-48fe-8ee2-ef9c74aa1498 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:49.173984 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ad8af0b8-4a0b-48fe-8ee2-ef9c74aa1498 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:49.174527 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ad8af0b8-4a0b-48fe-8ee2-ef9c74aa1498 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:49.175376 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ad8af0b8-4a0b-48fe-8ee2-ef9c74aa1498 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:49.175901 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ad8af0b8-4a0b-48fe-8ee2-ef9c74aa1498 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:49.176396 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ad8af0b8-4a0b-48fe-8ee2-ef9c74aa1498 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:49.307962 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-ad8af0b8-4a0b-48fe-8ee2-ef9c74aa1498 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:49.316989 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-ad8af0b8-4a0b-48fe-8ee2-ef9c74aa1498 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:49.318500 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-ad8af0b8-4a0b-48fe-8ee2-ef9c74aa1498 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:49.319834 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-ad8af0b8-4a0b-48fe-8ee2-ef9c74aa1498 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1809 microversion: 2.20 time: 0.161723 Aug 09 02:44:49.320401 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 280/573] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:44:49 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:44:50.042590 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-8cafc0a5-1446-4c81-b991-98abb80a3562 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:50.043564 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-8cafc0a5-1446-4c81-b991-98abb80a3562 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: b9369cf3-95d7-41d2-8157-ca2c165b062d] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:50.054401 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8cafc0a5-1446-4c81-b991-98abb80a3562 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:50.054883 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8cafc0a5-1446-4c81-b991-98abb80a3562 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:50.055314 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8cafc0a5-1446-4c81-b991-98abb80a3562 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:50.056003 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8cafc0a5-1446-4c81-b991-98abb80a3562 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:50.056448 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8cafc0a5-1446-4c81-b991-98abb80a3562 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:50.056872 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8cafc0a5-1446-4c81-b991-98abb80a3562 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:50.265312 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-8cafc0a5-1446-4c81-b991-98abb80a3562 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:50.274345 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-8cafc0a5-1446-4c81-b991-98abb80a3562 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d" status: 200 len: 1734 microversion: 2.1 time: 0.238413 Aug 09 02:44:50.274938 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 294/574] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:44:50 2022] GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d => generated 1734 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:44:50.342268 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-454d7f9c-2a7d-472f-bc2e-554ec3289027 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:50.342882 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-454d7f9c-2a7d-472f-bc2e-554ec3289027 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:50.349624 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-454d7f9c-2a7d-472f-bc2e-554ec3289027 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:50.350101 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-454d7f9c-2a7d-472f-bc2e-554ec3289027 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:50.350565 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-454d7f9c-2a7d-472f-bc2e-554ec3289027 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:50.351266 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-454d7f9c-2a7d-472f-bc2e-554ec3289027 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:50.351712 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-454d7f9c-2a7d-472f-bc2e-554ec3289027 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:50.352127 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-454d7f9c-2a7d-472f-bc2e-554ec3289027 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:50.492123 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-454d7f9c-2a7d-472f-bc2e-554ec3289027 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:50.500921 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-454d7f9c-2a7d-472f-bc2e-554ec3289027 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:50.502459 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-454d7f9c-2a7d-472f-bc2e-554ec3289027 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:50.503620 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-454d7f9c-2a7d-472f-bc2e-554ec3289027 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1809 microversion: 2.20 time: 0.165395 Aug 09 02:44:50.504149 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 281/575] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:44:50 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:44:51.302478 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-b575c4b6-1a6c-4238-b71c-541fcc38ce73 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:51.302478 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-b575c4b6-1a6c-4238-b71c-541fcc38ce73 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: b9369cf3-95d7-41d2-8157-ca2c165b062d] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:51.309181 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b575c4b6-1a6c-4238-b71c-541fcc38ce73 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:51.310881 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b575c4b6-1a6c-4238-b71c-541fcc38ce73 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:51.310881 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b575c4b6-1a6c-4238-b71c-541fcc38ce73 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:51.311438 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b575c4b6-1a6c-4238-b71c-541fcc38ce73 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:51.311902 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b575c4b6-1a6c-4238-b71c-541fcc38ce73 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:51.312320 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b575c4b6-1a6c-4238-b71c-541fcc38ce73 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:51.451316 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-b575c4b6-1a6c-4238-b71c-541fcc38ce73 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:51.459421 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-b575c4b6-1a6c-4238-b71c-541fcc38ce73 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d" status: 200 len: 1734 microversion: 2.1 time: 0.167736 Aug 09 02:44:51.460025 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 295/576] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:44:51 2022] GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:44:51.527709 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-f7247046-79a0-453f-bfca-ca461b840908 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:51.528643 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-f7247046-79a0-453f-bfca-ca461b840908 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:51.538887 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f7247046-79a0-453f-bfca-ca461b840908 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:51.539625 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f7247046-79a0-453f-bfca-ca461b840908 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:51.540297 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f7247046-79a0-453f-bfca-ca461b840908 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:51.541331 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f7247046-79a0-453f-bfca-ca461b840908 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:51.542017 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f7247046-79a0-453f-bfca-ca461b840908 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:51.542705 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f7247046-79a0-453f-bfca-ca461b840908 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:51.697150 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-f7247046-79a0-453f-bfca-ca461b840908 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:51.705758 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-f7247046-79a0-453f-bfca-ca461b840908 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:51.707310 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-f7247046-79a0-453f-bfca-ca461b840908 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:51.708491 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-f7247046-79a0-453f-bfca-ca461b840908 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1809 microversion: 2.20 time: 0.185831 Aug 09 02:44:51.709052 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 282/577] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:44:51 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1809 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:44:52.482464 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-eaf4a78f-08f6-4182-90ec-e88f4e36ffd5 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:52.483081 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-eaf4a78f-08f6-4182-90ec-e88f4e36ffd5 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: b9369cf3-95d7-41d2-8157-ca2c165b062d] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:52.493130 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-eaf4a78f-08f6-4182-90ec-e88f4e36ffd5 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:52.493743 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-eaf4a78f-08f6-4182-90ec-e88f4e36ffd5 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:52.494189 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-eaf4a78f-08f6-4182-90ec-e88f4e36ffd5 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:52.494877 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-eaf4a78f-08f6-4182-90ec-e88f4e36ffd5 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:52.495325 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-eaf4a78f-08f6-4182-90ec-e88f4e36ffd5 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:52.495747 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-eaf4a78f-08f6-4182-90ec-e88f4e36ffd5 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:52.638569 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-eaf4a78f-08f6-4182-90ec-e88f4e36ffd5 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:52.646943 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-eaf4a78f-08f6-4182-90ec-e88f4e36ffd5 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d" status: 200 len: 1714 microversion: 2.1 time: 0.170322 Aug 09 02:44:52.647553 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 296/578] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:44:52 2022] GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d => generated 1714 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:44:52.731298 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-8e3bb9ef-787e-4d0a-b06c-b04bc89a4a05 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:52.731900 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-8e3bb9ef-787e-4d0a-b06c-b04bc89a4a05 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:52.738754 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8e3bb9ef-787e-4d0a-b06c-b04bc89a4a05 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:52.739258 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8e3bb9ef-787e-4d0a-b06c-b04bc89a4a05 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:52.739685 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8e3bb9ef-787e-4d0a-b06c-b04bc89a4a05 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:52.740347 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8e3bb9ef-787e-4d0a-b06c-b04bc89a4a05 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:52.740793 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8e3bb9ef-787e-4d0a-b06c-b04bc89a4a05 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:52.741191 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8e3bb9ef-787e-4d0a-b06c-b04bc89a4a05 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:52.759908 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-3b769444-c1da-4d2b-a367-8904a85f666b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:52.760434 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-3b769444-c1da-4d2b-a367-8904a85f666b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: b9369cf3-95d7-41d2-8157-ca2c165b062d] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:52.766556 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3b769444-c1da-4d2b-a367-8904a85f666b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:52.767041 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3b769444-c1da-4d2b-a367-8904a85f666b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:52.767472 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3b769444-c1da-4d2b-a367-8904a85f666b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:52.768159 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3b769444-c1da-4d2b-a367-8904a85f666b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:52.768613 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3b769444-c1da-4d2b-a367-8904a85f666b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:52.769035 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3b769444-c1da-4d2b-a367-8904a85f666b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:52.852053 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.wsgi [None req-3b769444-c1da-4d2b-a367-8904a85f666b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] HTTP exception thrown: Cannot 'detach_volume' instance b9369cf3-95d7-41d2-8157-ca2c165b062d while it is in vm_state rescued Aug 09 02:44:52.853758 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-3b769444-c1da-4d2b-a367-8904a85f666b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Request method failure captured: Aug 09 02:44:52.853758 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: request: DELETE /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d/os-volume_attachments/553e3daa-06f7-485f-8835-4e102fd8880c HTTP/1.1 Aug 09 02:44:52.853758 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Accept: application/json Aug 09 02:44:52.853758 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Accept-Encoding: identity Aug 09 02:44:52.853758 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Connection: close Aug 09 02:44:52.853758 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Content-Length: 0 Aug 09 02:44:52.853758 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Content-Type: application/json Aug 09 02:44:52.853758 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Host: 10.222.0.20 Aug 09 02:44:52.853758 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Openstack-System-Scope: None Aug 09 02:44:52.853758 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: User-Agent: python-urllib3/1.26.11 Aug 09 02:44:52.853758 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Auth-Token: gAAAAABi8ck0CktcbMqTyHyXW8raM7iadadJrEMEsJe1QuxYKiBhpTouij9hVxYkaHqXy09_JT1eLz1wDM3rcA0s4PsRbPJ5NcIAOnut9F1rfjVmZ0ZLJHay53lPPXa7QLsuxiazoAiezHqBT1Xd8Rz6-J34U6-EpZWhwazb9UjXN8mMBEdn5c0 Aug 09 02:44:52.853758 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Domain-Id: None Aug 09 02:44:52.853758 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Domain-Name: None Aug 09 02:44:52.853758 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Identity-Status: Confirmed Aug 09 02:44:52.853758 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Is-Admin-Project: True Aug 09 02:44:52.853758 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Domain-Id: default Aug 09 02:44:52.853758 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Domain-Name: Default Aug 09 02:44:52.853758 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Id: 65aab6ab3ce94cbd93916edf9c3eedc0 Aug 09 02:44:52.853758 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-806361088 Aug 09 02:44:52.853758 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Role: reader,member Aug 09 02:44:52.853758 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Roles: reader,member Aug 09 02:44:52.855343 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/65aab6ab3ce94cbd93916edf9c3eedc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/65aab6ab3ce94cbd93916edf9c3eedc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_65aab6ab3ce94cbd93916edf9c3eedc0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/65aab6ab3ce94cbd93916edf9c3eedc0"}]}] Aug 09 02:44:52.855343 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant: tempest-ServerRescueNegativeTestJSON-806361088 Aug 09 02:44:52.855343 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant-Id: 65aab6ab3ce94cbd93916edf9c3eedc0 Aug 09 02:44:52.855343 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-806361088 Aug 09 02:44:52.855343 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User: tempest-ServerRescueNegativeTestJSON-806361088-project Aug 09 02:44:52.855343 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Domain-Id: default Aug 09 02:44:52.855343 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Domain-Name: Default Aug 09 02:44:52.855343 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Id: 192a8abd4c7a4535a42bea7648535dc3 Aug 09 02:44:52.855343 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Name: tempest-ServerRescueNegativeTestJSON-806361088-project Aug 09 02:44:52.855343 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: method: > Aug 09 02:44:52.855343 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: exception: Cannot 'detach_volume' instance b9369cf3-95d7-41d2-8157-ca2c165b062d while it is in vm_state rescued Aug 09 02:44:52.856099 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: action_args: {'server_id': 'b9369cf3-95d7-41d2-8157-ca2c165b062d', 'id': '553e3daa-06f7-485f-8835-4e102fd8880c'} Aug 09 02:44:52.856099 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 02:44:52.856099 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:44:52.856099 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 09 02:44:52.856099 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 09 02:44:52.856099 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 02:44:52.856099 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 02:44:52.856099 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 09 02:44:52.856099 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 09 02:44:52.856099 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b9369cf3-95d7-41d2-8157-ca2c165b062d in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 09 02:44:52.856099 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:44:52.856099 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:44:52.856099 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:44:52.856099 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:44:52.856099 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:44:52.856099 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:44:52.856099 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 02:44:52.856099 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 02:44:52.856099 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 02:44:52.856099 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 02:44:52.857402 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 09 02:44:52.857402 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 09 02:44:52.857402 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 09 02:44:52.857402 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 09 02:44:52.857402 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance b9369cf3-95d7-41d2-8157-ca2c165b062d while it is in vm_state rescued Aug 09 02:44:52.857402 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:44:52.857402 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:44:52.857402 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:44:52.857402 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:44:52.857402 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:44:52.857402 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:44:52.857402 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 02:44:52.857402 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 02:44:52.857402 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance b9369cf3-95d7-41d2-8157-ca2c165b062d while it is in vm_state rescued Aug 09 02:44:52.857402 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:44:52.857402 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-3b769444-c1da-4d2b-a367-8904a85f666b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Returning 409 to user: Cannot 'detach_volume' instance b9369cf3-95d7-41d2-8157-ca2c165b062d while it is in vm_state rescued {{(pid=124427) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 02:44:52.858415 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-3b769444-c1da-4d2b-a367-8904a85f666b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d/os-volume_attachments/553e3daa-06f7-485f-8835-4e102fd8880c" status: 409 len: 152 microversion: 2.1 time: 0.099492 Aug 09 02:44:52.858415 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 297/579] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Aug 9 02:44:52 2022] DELETE /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d/os-volume_attachments/553e3daa-06f7-485f-8835-4e102fd8880c => generated 152 bytes in 101 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 09 02:44:52.864638 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-5533f975-cb9f-4733-b294-3d4fa8dc0e1a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:44:52.865167 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-5533f975-cb9f-4733-b294-3d4fa8dc0e1a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: b9369cf3-95d7-41d2-8157-ca2c165b062d] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:52.872000 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5533f975-cb9f-4733-b294-3d4fa8dc0e1a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:52.872491 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5533f975-cb9f-4733-b294-3d4fa8dc0e1a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:52.872924 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5533f975-cb9f-4733-b294-3d4fa8dc0e1a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:52.873621 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5533f975-cb9f-4733-b294-3d4fa8dc0e1a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:52.874107 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5533f975-cb9f-4733-b294-3d4fa8dc0e1a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:52.874580 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5533f975-cb9f-4733-b294-3d4fa8dc0e1a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:52.875377 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-8e3bb9ef-787e-4d0a-b06c-b04bc89a4a05 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:52.884173 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-8e3bb9ef-787e-4d0a-b06c-b04bc89a4a05 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:52.885811 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-8e3bb9ef-787e-4d0a-b06c-b04bc89a4a05 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:52.887091 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-8e3bb9ef-787e-4d0a-b06c-b04bc89a4a05 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1809 microversion: 2.20 time: 0.159785 Aug 09 02:44:52.887746 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 283/580] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:44:52 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:44:52.940268 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-5533f975-cb9f-4733-b294-3d4fa8dc0e1a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "POST /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d/action" status: 202 len: 0 microversion: 2.1 time: 0.079176 Aug 09 02:44:52.940890 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 298/581] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Aug 9 02:44:52 2022] POST /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 02:44:52.949234 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-c8c4679e-e72b-4dce-a734-5606df389741 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:52.949923 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-c8c4679e-e72b-4dce-a734-5606df389741 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: b9369cf3-95d7-41d2-8157-ca2c165b062d] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:52.955904 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c8c4679e-e72b-4dce-a734-5606df389741 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:52.956478 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c8c4679e-e72b-4dce-a734-5606df389741 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:52.956967 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c8c4679e-e72b-4dce-a734-5606df389741 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:52.957688 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c8c4679e-e72b-4dce-a734-5606df389741 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:52.958142 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c8c4679e-e72b-4dce-a734-5606df389741 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:52.958622 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c8c4679e-e72b-4dce-a734-5606df389741 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:53.160558 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-c8c4679e-e72b-4dce-a734-5606df389741 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:53.169362 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-c8c4679e-e72b-4dce-a734-5606df389741 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d" status: 200 len: 1722 microversion: 2.1 time: 0.223952 Aug 09 02:44:53.170048 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 284/582] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:44:52 2022] GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d => generated 1722 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:44:53.915025 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-44b03940-2a0b-41d6-8ee2-365f73343337 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:53.916085 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-44b03940-2a0b-41d6-8ee2-365f73343337 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:53.925696 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-44b03940-2a0b-41d6-8ee2-365f73343337 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:53.926494 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-44b03940-2a0b-41d6-8ee2-365f73343337 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:53.927158 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-44b03940-2a0b-41d6-8ee2-365f73343337 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:53.928197 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-44b03940-2a0b-41d6-8ee2-365f73343337 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:53.928882 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-44b03940-2a0b-41d6-8ee2-365f73343337 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:53.929528 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-44b03940-2a0b-41d6-8ee2-365f73343337 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:54.082407 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-44b03940-2a0b-41d6-8ee2-365f73343337 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:54.092943 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-44b03940-2a0b-41d6-8ee2-365f73343337 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:54.094451 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-44b03940-2a0b-41d6-8ee2-365f73343337 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:54.095621 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-44b03940-2a0b-41d6-8ee2-365f73343337 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1809 microversion: 2.20 time: 0.187986 Aug 09 02:44:54.096170 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 299/583] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:44:53 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1809 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:44:54.196137 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-97b79934-bfc1-4ce0-a40d-40fe2892a735 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:54.197050 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-97b79934-bfc1-4ce0-a40d-40fe2892a735 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: b9369cf3-95d7-41d2-8157-ca2c165b062d] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:54.204053 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-97b79934-bfc1-4ce0-a40d-40fe2892a735 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:54.204533 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-97b79934-bfc1-4ce0-a40d-40fe2892a735 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:54.204970 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-97b79934-bfc1-4ce0-a40d-40fe2892a735 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:54.205654 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-97b79934-bfc1-4ce0-a40d-40fe2892a735 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:54.206105 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-97b79934-bfc1-4ce0-a40d-40fe2892a735 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:54.206567 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-97b79934-bfc1-4ce0-a40d-40fe2892a735 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:54.343401 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-97b79934-bfc1-4ce0-a40d-40fe2892a735 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:54.353025 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-97b79934-bfc1-4ce0-a40d-40fe2892a735 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d" status: 200 len: 1722 microversion: 2.1 time: 0.163492 Aug 09 02:44:54.353599 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 285/584] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:44:54 2022] GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:44:55.119153 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-8b13c5f6-8e7b-4455-8e35-c7bc41800624 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:55.119843 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-8b13c5f6-8e7b-4455-8e35-c7bc41800624 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:55.126778 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8b13c5f6-8e7b-4455-8e35-c7bc41800624 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:55.127290 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8b13c5f6-8e7b-4455-8e35-c7bc41800624 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:55.127728 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8b13c5f6-8e7b-4455-8e35-c7bc41800624 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:55.128423 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8b13c5f6-8e7b-4455-8e35-c7bc41800624 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:55.128877 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8b13c5f6-8e7b-4455-8e35-c7bc41800624 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:55.129299 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8b13c5f6-8e7b-4455-8e35-c7bc41800624 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:55.265880 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-8b13c5f6-8e7b-4455-8e35-c7bc41800624 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:55.277673 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-8b13c5f6-8e7b-4455-8e35-c7bc41800624 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:55.279241 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-8b13c5f6-8e7b-4455-8e35-c7bc41800624 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:55.280404 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-8b13c5f6-8e7b-4455-8e35-c7bc41800624 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1809 microversion: 2.20 time: 0.165251 Aug 09 02:44:55.280963 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 300/585] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:44:55 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:44:55.378244 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-402dc2ee-8da1-44a2-99e1-14cb376c3894 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:55.378782 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-402dc2ee-8da1-44a2-99e1-14cb376c3894 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: b9369cf3-95d7-41d2-8157-ca2c165b062d] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:55.388663 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-402dc2ee-8da1-44a2-99e1-14cb376c3894 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:55.389320 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-402dc2ee-8da1-44a2-99e1-14cb376c3894 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:55.389801 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-402dc2ee-8da1-44a2-99e1-14cb376c3894 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:55.390800 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-402dc2ee-8da1-44a2-99e1-14cb376c3894 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:55.391382 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-402dc2ee-8da1-44a2-99e1-14cb376c3894 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:55.391932 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-402dc2ee-8da1-44a2-99e1-14cb376c3894 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:55.538325 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-402dc2ee-8da1-44a2-99e1-14cb376c3894 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:55.546606 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-402dc2ee-8da1-44a2-99e1-14cb376c3894 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d" status: 200 len: 1722 microversion: 2.1 time: 0.174689 Aug 09 02:44:55.547172 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 286/586] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:44:55 2022] GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:44:56.307453 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-bbd0853f-fd13-45a3-a4ce-ea98f7fede59 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:56.308190 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-bbd0853f-fd13-45a3-a4ce-ea98f7fede59 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:56.316763 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-bbd0853f-fd13-45a3-a4ce-ea98f7fede59 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:56.317149 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-bbd0853f-fd13-45a3-a4ce-ea98f7fede59 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:56.317813 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-bbd0853f-fd13-45a3-a4ce-ea98f7fede59 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:56.318595 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-bbd0853f-fd13-45a3-a4ce-ea98f7fede59 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:56.319149 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-bbd0853f-fd13-45a3-a4ce-ea98f7fede59 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:56.319678 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-bbd0853f-fd13-45a3-a4ce-ea98f7fede59 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:56.466673 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-bbd0853f-fd13-45a3-a4ce-ea98f7fede59 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:56.475772 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-bbd0853f-fd13-45a3-a4ce-ea98f7fede59 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:56.477255 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-bbd0853f-fd13-45a3-a4ce-ea98f7fede59 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:56.478510 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-bbd0853f-fd13-45a3-a4ce-ea98f7fede59 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1809 microversion: 2.20 time: 0.177485 Aug 09 02:44:56.479034 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 301/587] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:44:56 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:44:56.571071 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-22975662-10c9-4db3-980e-c9dab1768ddf tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:56.572341 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-22975662-10c9-4db3-980e-c9dab1768ddf tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: b9369cf3-95d7-41d2-8157-ca2c165b062d] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:56.579362 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-22975662-10c9-4db3-980e-c9dab1768ddf tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:56.579925 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-22975662-10c9-4db3-980e-c9dab1768ddf tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:56.580366 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-22975662-10c9-4db3-980e-c9dab1768ddf tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:56.581062 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-22975662-10c9-4db3-980e-c9dab1768ddf tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:56.581514 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-22975662-10c9-4db3-980e-c9dab1768ddf tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:56.581944 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-22975662-10c9-4db3-980e-c9dab1768ddf tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:56.723059 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-22975662-10c9-4db3-980e-c9dab1768ddf tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:56.736578 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-22975662-10c9-4db3-980e-c9dab1768ddf tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d" status: 200 len: 1722 microversion: 2.1 time: 0.171878 Aug 09 02:44:56.737408 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 287/588] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:44:56 2022] GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:44:57.511193 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-1b761493-8316-4677-8c8a-e918442597d1 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:57.512710 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-1b761493-8316-4677-8c8a-e918442597d1 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:57.523841 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1b761493-8316-4677-8c8a-e918442597d1 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:57.524605 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1b761493-8316-4677-8c8a-e918442597d1 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:57.525279 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1b761493-8316-4677-8c8a-e918442597d1 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:57.526027 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1b761493-8316-4677-8c8a-e918442597d1 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:57.526554 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1b761493-8316-4677-8c8a-e918442597d1 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:57.527029 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1b761493-8316-4677-8c8a-e918442597d1 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:57.662359 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-1b761493-8316-4677-8c8a-e918442597d1 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:57.675722 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-1b761493-8316-4677-8c8a-e918442597d1 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:57.677973 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-1b761493-8316-4677-8c8a-e918442597d1 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:57.679802 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-1b761493-8316-4677-8c8a-e918442597d1 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1809 microversion: 2.20 time: 0.172519 Aug 09 02:44:57.680550 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 302/589] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:44:57 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:44:57.766095 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-b53af70c-5ed3-4c63-b268-1abf27413fdb tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:57.767008 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-b53af70c-5ed3-4c63-b268-1abf27413fdb tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: b9369cf3-95d7-41d2-8157-ca2c165b062d] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:57.776991 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b53af70c-5ed3-4c63-b268-1abf27413fdb tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:57.777422 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b53af70c-5ed3-4c63-b268-1abf27413fdb tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:57.777825 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b53af70c-5ed3-4c63-b268-1abf27413fdb tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:57.778556 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b53af70c-5ed3-4c63-b268-1abf27413fdb tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:57.779017 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b53af70c-5ed3-4c63-b268-1abf27413fdb tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:57.779422 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b53af70c-5ed3-4c63-b268-1abf27413fdb tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:57.913672 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-b53af70c-5ed3-4c63-b268-1abf27413fdb tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:57.922022 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-b53af70c-5ed3-4c63-b268-1abf27413fdb tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d" status: 200 len: 1728 microversion: 2.1 time: 0.162390 Aug 09 02:44:57.922632 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 288/590] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:44:57 2022] GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d => generated 1728 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:44:57.942474 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-b2f30403-1a21-49c1-8040-74940e4a4f15 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:57.942964 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-b2f30403-1a21-49c1-8040-74940e4a4f15 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: b9369cf3-95d7-41d2-8157-ca2c165b062d] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:57.949506 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b2f30403-1a21-49c1-8040-74940e4a4f15 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:57.950136 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b2f30403-1a21-49c1-8040-74940e4a4f15 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:57.950641 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b2f30403-1a21-49c1-8040-74940e4a4f15 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:57.951330 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b2f30403-1a21-49c1-8040-74940e4a4f15 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:57.951789 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b2f30403-1a21-49c1-8040-74940e4a4f15 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:57.952239 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b2f30403-1a21-49c1-8040-74940e4a4f15 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:58.029765 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-b2f30403-1a21-49c1-8040-74940e4a4f15 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091263 Aug 09 02:44:58.030408 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 303/591] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Aug 9 02:44:57 2022] GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 02:44:58.703501 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-9a679f42-ab36-42b4-af2b-03fe68c5d4a8 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:58.704126 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-9a679f42-ab36-42b4-af2b-03fe68c5d4a8 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:58.710636 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9a679f42-ab36-42b4-af2b-03fe68c5d4a8 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:58.711116 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9a679f42-ab36-42b4-af2b-03fe68c5d4a8 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:58.711542 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9a679f42-ab36-42b4-af2b-03fe68c5d4a8 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:58.712224 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9a679f42-ab36-42b4-af2b-03fe68c5d4a8 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:58.712670 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9a679f42-ab36-42b4-af2b-03fe68c5d4a8 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:58.713087 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9a679f42-ab36-42b4-af2b-03fe68c5d4a8 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:58.901795 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-9a679f42-ab36-42b4-af2b-03fe68c5d4a8 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:58.913625 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-9a679f42-ab36-42b4-af2b-03fe68c5d4a8 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:58.915559 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-9a679f42-ab36-42b4-af2b-03fe68c5d4a8 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:44:58.916812 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-9a679f42-ab36-42b4-af2b-03fe68c5d4a8 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1809 microversion: 2.20 time: 0.217287 Aug 09 02:44:58.917385 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 289/592] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:44:58 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1809 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:44:59.006375 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [req-6c10df69-b830-4c60-8d16-3904a671b73c req-976a28d8-a8a9-4bc5-85bb-93dd882cfdf0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9369cf3-95d7-41d2-8157-ca2c165b062d", "tag": "5340ab1c-d934-4cfa-bf83-c7ba28e47a66"}]} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:44:59.016195 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-6c10df69-b830-4c60-8d16-3904a671b73c req-976a28d8-a8a9-4bc5-85bb-93dd882cfdf0 service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:59.016685 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-6c10df69-b830-4c60-8d16-3904a671b73c req-976a28d8-a8a9-4bc5-85bb-93dd882cfdf0 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:59.017115 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-6c10df69-b830-4c60-8d16-3904a671b73c req-976a28d8-a8a9-4bc5-85bb-93dd882cfdf0 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:59.029020 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.compute.server_external_events [req-6c10df69-b830-4c60-8d16-3904a671b73c req-976a28d8-a8a9-4bc5-85bb-93dd882cfdf0 service nova] Creating event network-changed:5340ab1c-d934-4cfa-bf83-c7ba28e47a66 for instance b9369cf3-95d7-41d2-8157-ca2c165b062d on hv-cinder-85246 Aug 09 02:44:59.034320 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [req-6c10df69-b830-4c60-8d16-3904a671b73c req-976a28d8-a8a9-4bc5-85bb-93dd882cfdf0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032264 Aug 09 02:44:59.034968 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 304/593] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:44:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:44:59.601844 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [req-bf1cf105-b14c-4213-af54-47cc12963911 req-cfa9219a-d1af-4b87-9a6d-b2a3a85f1c48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9919dd32-c9e0-42ae-8981-414c2e663e73", "name": "network-vif-plugged", "status": "completed", "tag": "e32a0be8-e008-4397-89d0-66d5a85e0515"}]} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:44:59.613051 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-bf1cf105-b14c-4213-af54-47cc12963911 req-cfa9219a-d1af-4b87-9a6d-b2a3a85f1c48 service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:59.613551 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-bf1cf105-b14c-4213-af54-47cc12963911 req-cfa9219a-d1af-4b87-9a6d-b2a3a85f1c48 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:59.613979 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-bf1cf105-b14c-4213-af54-47cc12963911 req-cfa9219a-d1af-4b87-9a6d-b2a3a85f1c48 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:59.625833 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.compute.server_external_events [req-bf1cf105-b14c-4213-af54-47cc12963911 req-cfa9219a-d1af-4b87-9a6d-b2a3a85f1c48 service nova] Creating event network-vif-plugged:e32a0be8-e008-4397-89d0-66d5a85e0515 for instance 9919dd32-c9e0-42ae-8981-414c2e663e73 on hv-cinder-85246 Aug 09 02:44:59.632646 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [req-bf1cf105-b14c-4213-af54-47cc12963911 req-cfa9219a-d1af-4b87-9a6d-b2a3a85f1c48 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034609 Aug 09 02:44:59.633406 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 290/594] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:44:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:44:59.939772 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-a42cea4c-9875-43fa-bc46-17b96b9c1a30 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:44:59.940470 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-a42cea4c-9875-43fa-bc46-17b96b9c1a30 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:44:59.947181 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a42cea4c-9875-43fa-bc46-17b96b9c1a30 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:59.947662 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a42cea4c-9875-43fa-bc46-17b96b9c1a30 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:59.948087 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a42cea4c-9875-43fa-bc46-17b96b9c1a30 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:44:59.948773 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a42cea4c-9875-43fa-bc46-17b96b9c1a30 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:44:59.949217 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a42cea4c-9875-43fa-bc46-17b96b9c1a30 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:44:59.949625 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a42cea4c-9875-43fa-bc46-17b96b9c1a30 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:00.086970 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-a42cea4c-9875-43fa-bc46-17b96b9c1a30 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:00.096188 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-a42cea4c-9875-43fa-bc46-17b96b9c1a30 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:00.097856 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-a42cea4c-9875-43fa-bc46-17b96b9c1a30 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:00.099464 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-a42cea4c-9875-43fa-bc46-17b96b9c1a30 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1809 microversion: 2.20 time: 0.163656 Aug 09 02:45:00.100350 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 305/595] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:44:59 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:45:01.052111 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [req-12ea0a85-b451-47cb-bfd2-e4ec5d8339a9 req-ffc5af61-0dee-42e7-a66e-f24fcf2f0b01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9369cf3-95d7-41d2-8157-ca2c165b062d", "tag": "5340ab1c-d934-4cfa-bf83-c7ba28e47a66"}]} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:45:01.062635 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-12ea0a85-b451-47cb-bfd2-e4ec5d8339a9 req-ffc5af61-0dee-42e7-a66e-f24fcf2f0b01 service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:01.063131 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-12ea0a85-b451-47cb-bfd2-e4ec5d8339a9 req-ffc5af61-0dee-42e7-a66e-f24fcf2f0b01 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:01.063580 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-12ea0a85-b451-47cb-bfd2-e4ec5d8339a9 req-ffc5af61-0dee-42e7-a66e-f24fcf2f0b01 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:01.075681 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.compute.server_external_events [req-12ea0a85-b451-47cb-bfd2-e4ec5d8339a9 req-ffc5af61-0dee-42e7-a66e-f24fcf2f0b01 service nova] Creating event network-changed:5340ab1c-d934-4cfa-bf83-c7ba28e47a66 for instance b9369cf3-95d7-41d2-8157-ca2c165b062d on hv-cinder-85246 Aug 09 02:45:01.080615 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [req-12ea0a85-b451-47cb-bfd2-e4ec5d8339a9 req-ffc5af61-0dee-42e7-a66e-f24fcf2f0b01 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033981 Aug 09 02:45:01.081236 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 291/596] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:45:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:45:01.123893 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-4285d613-3f75-4975-9b68-dc451efc5085 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:01.124513 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-4285d613-3f75-4975-9b68-dc451efc5085 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:01.131081 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4285d613-3f75-4975-9b68-dc451efc5085 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:01.131555 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4285d613-3f75-4975-9b68-dc451efc5085 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:01.131968 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4285d613-3f75-4975-9b68-dc451efc5085 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:01.132667 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4285d613-3f75-4975-9b68-dc451efc5085 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:01.133116 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4285d613-3f75-4975-9b68-dc451efc5085 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:01.133526 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4285d613-3f75-4975-9b68-dc451efc5085 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:01.317152 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-4285d613-3f75-4975-9b68-dc451efc5085 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:01.326837 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-4285d613-3f75-4975-9b68-dc451efc5085 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:01.328332 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-4285d613-3f75-4975-9b68-dc451efc5085 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:01.329478 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-4285d613-3f75-4975-9b68-dc451efc5085 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1809 microversion: 2.20 time: 0.209582 Aug 09 02:45:01.330054 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 306/597] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:45:01 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1809 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:45:02.354611 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-1b1429b0-ee54-4184-93d1-9ae2c39a642d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:02.355312 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-1b1429b0-ee54-4184-93d1-9ae2c39a642d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:02.357272 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_api:SELECT=59 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:45:02.363200 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1b1429b0-ee54-4184-93d1-9ae2c39a642d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:02.363678 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1b1429b0-ee54-4184-93d1-9ae2c39a642d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:02.364106 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1b1429b0-ee54-4184-93d1-9ae2c39a642d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:02.364796 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1b1429b0-ee54-4184-93d1-9ae2c39a642d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:02.365244 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1b1429b0-ee54-4184-93d1-9ae2c39a642d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:02.365659 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1b1429b0-ee54-4184-93d1-9ae2c39a642d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:02.513187 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-1b1429b0-ee54-4184-93d1-9ae2c39a642d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:02.522410 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-1b1429b0-ee54-4184-93d1-9ae2c39a642d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:02.523907 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-1b1429b0-ee54-4184-93d1-9ae2c39a642d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:02.525072 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-1b1429b0-ee54-4184-93d1-9ae2c39a642d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1809 microversion: 2.20 time: 0.175502 Aug 09 02:45:02.525630 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 292/598] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:45:02 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:45:03.552574 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-7e98f790-6765-4051-a84e-62dc65eb3839 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:03.553382 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-7e98f790-6765-4051-a84e-62dc65eb3839 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:03.562046 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7e98f790-6765-4051-a84e-62dc65eb3839 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:03.562576 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7e98f790-6765-4051-a84e-62dc65eb3839 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:03.563026 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7e98f790-6765-4051-a84e-62dc65eb3839 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:03.563720 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7e98f790-6765-4051-a84e-62dc65eb3839 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:03.564169 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7e98f790-6765-4051-a84e-62dc65eb3839 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:03.564592 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7e98f790-6765-4051-a84e-62dc65eb3839 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:03.706083 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-7e98f790-6765-4051-a84e-62dc65eb3839 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:03.708423 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-4b106995-c63d-43af-8107-7afb80cb6894 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1282670488"}} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:45:03.708930 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-4b106995-c63d-43af-8107-7afb80cb6894 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] [instance: 7cfae5d5-8846-4c6d-8e56-5a52f817b48e] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:03.715058 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-7e98f790-6765-4051-a84e-62dc65eb3839 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:03.715653 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4b106995-c63d-43af-8107-7afb80cb6894 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:03.716157 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4b106995-c63d-43af-8107-7afb80cb6894 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:03.716566 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-7e98f790-6765-4051-a84e-62dc65eb3839 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:03.716692 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4b106995-c63d-43af-8107-7afb80cb6894 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:03.717262 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4b106995-c63d-43af-8107-7afb80cb6894 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:03.717707 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4b106995-c63d-43af-8107-7afb80cb6894 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:03.717806 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-7e98f790-6765-4051-a84e-62dc65eb3839 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1796 microversion: 2.20 time: 0.172349 Aug 09 02:45:03.718119 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4b106995-c63d-43af-8107-7afb80cb6894 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:03.722195 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 307/599] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:45:03 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1796 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:45:03.843673 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.network.security_group_api [None req-4b106995-c63d-43af-8107-7afb80cb6894 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Removing security group 7e19b9f8-7e81-4515-aa48-2923ab7b3de8 from port e3bd4b2e-303f-4020-9be9-d72af9307f8a Aug 09 02:45:04.185111 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-4b106995-c63d-43af-8107-7afb80cb6894 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] 10.222.0.20 "POST /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e/action" status: 202 len: 0 microversion: 2.1 time: 0.480525 Aug 09 02:45:04.185721 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 293/600] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Aug 9 02:45:03 2022] POST /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e/action => generated 0 bytes in 482 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 02:45:04.195382 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [req-67dfdeb5-b82e-48ae-a9f5-1d1966fea2e4 req-d391ae49-f4ac-4e55-b1b2-d95dde8d018f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cfae5d5-8846-4c6d-8e56-5a52f817b48e", "tag": "e3bd4b2e-303f-4020-9be9-d72af9307f8a"}]} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:45:04.204900 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-67dfdeb5-b82e-48ae-a9f5-1d1966fea2e4 req-d391ae49-f4ac-4e55-b1b2-d95dde8d018f service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:04.205461 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-67dfdeb5-b82e-48ae-a9f5-1d1966fea2e4 req-d391ae49-f4ac-4e55-b1b2-d95dde8d018f service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:04.206081 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-67dfdeb5-b82e-48ae-a9f5-1d1966fea2e4 req-d391ae49-f4ac-4e55-b1b2-d95dde8d018f service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:04.210061 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:45:04.219999 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.compute.server_external_events [req-67dfdeb5-b82e-48ae-a9f5-1d1966fea2e4 req-d391ae49-f4ac-4e55-b1b2-d95dde8d018f service nova] Creating event network-changed:e3bd4b2e-303f-4020-9be9-d72af9307f8a for instance 7cfae5d5-8846-4c6d-8e56-5a52f817b48e on hv-cinder-85246 Aug 09 02:45:04.225369 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [req-67dfdeb5-b82e-48ae-a9f5-1d1966fea2e4 req-d391ae49-f4ac-4e55-b1b2-d95dde8d018f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033874 Aug 09 02:45:04.226182 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 308/601] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:45:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:45:05.494650 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-e14de903-de05-4b69-a0ad-653e20a1622d tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:05.495443 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-e14de903-de05-4b69-a0ad-653e20a1622d tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] [instance: 7cfae5d5-8846-4c6d-8e56-5a52f817b48e] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:05.496259 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [req-e2e4916c-9a5c-4448-855c-433684143f89 req-bac81464-a834-4e78-97b5-3d8efd5dd41d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cfae5d5-8846-4c6d-8e56-5a52f817b48e", "tag": "e3bd4b2e-303f-4020-9be9-d72af9307f8a"}]} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:45:05.501937 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e14de903-de05-4b69-a0ad-653e20a1622d tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:05.502554 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e14de903-de05-4b69-a0ad-653e20a1622d tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:05.503193 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e14de903-de05-4b69-a0ad-653e20a1622d tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:05.503906 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e14de903-de05-4b69-a0ad-653e20a1622d tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:05.504353 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e14de903-de05-4b69-a0ad-653e20a1622d tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:05.504780 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e14de903-de05-4b69-a0ad-653e20a1622d tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:05.510081 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-e2e4916c-9a5c-4448-855c-433684143f89 req-bac81464-a834-4e78-97b5-3d8efd5dd41d service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:05.510717 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-e2e4916c-9a5c-4448-855c-433684143f89 req-bac81464-a834-4e78-97b5-3d8efd5dd41d service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:05.511326 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-e2e4916c-9a5c-4448-855c-433684143f89 req-bac81464-a834-4e78-97b5-3d8efd5dd41d service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:05.523301 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.compute.server_external_events [req-e2e4916c-9a5c-4448-855c-433684143f89 req-bac81464-a834-4e78-97b5-3d8efd5dd41d service nova] Creating event network-changed:e3bd4b2e-303f-4020-9be9-d72af9307f8a for instance 7cfae5d5-8846-4c6d-8e56-5a52f817b48e on hv-cinder-85246 Aug 09 02:45:05.529159 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [req-e2e4916c-9a5c-4448-855c-433684143f89 req-bac81464-a834-4e78-97b5-3d8efd5dd41d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038284 Aug 09 02:45:05.530447 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 309/602] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:45:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 02:45:05.589998 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.objects.instance [None req-e14de903-de05-4b69-a0ad-653e20a1622d tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lazy-loading 'services' on Instance uuid 7cfae5d5-8846-4c6d-8e56-5a52f817b48e {{(pid=124425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 02:45:05.593423 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_cell1:SELECT=100 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:45:05.669873 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-e14de903-de05-4b69-a0ad-653e20a1622d tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e/os-volume_attachments/0577e2d0-7dfe-44ea-8c32-cffd78a27ddf" status: 202 len: 0 microversion: 2.1 time: 0.179647 Aug 09 02:45:05.670770 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 294/603] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Aug 9 02:45:05 2022] DELETE /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e/os-volume_attachments/0577e2d0-7dfe-44ea-8c32-cffd78a27ddf => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 02:45:05.681608 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-787cc628-dc64-4638-a902-a19819168ecd tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:05.684942 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-787cc628-dc64-4638-a902-a19819168ecd tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] [instance: 7cfae5d5-8846-4c6d-8e56-5a52f817b48e] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:05.696070 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-787cc628-dc64-4638-a902-a19819168ecd tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:05.696863 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-787cc628-dc64-4638-a902-a19819168ecd tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:05.697549 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-787cc628-dc64-4638-a902-a19819168ecd tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:05.698836 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-787cc628-dc64-4638-a902-a19819168ecd tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:05.699387 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-787cc628-dc64-4638-a902-a19819168ecd tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:05.700175 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-787cc628-dc64-4638-a902-a19819168ecd tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:05.734668 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-787cc628-dc64-4638-a902-a19819168ecd tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] 10.222.0.20 "GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058330 Aug 09 02:45:05.739936 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 310/604] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 9 02:45:05 2022] GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 02:45:06.750195 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-59a63716-3f70-4ef0-a468-49f3dba4e91f tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:06.752655 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-59a63716-3f70-4ef0-a468-49f3dba4e91f tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] [instance: 7cfae5d5-8846-4c6d-8e56-5a52f817b48e] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:06.759258 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-59a63716-3f70-4ef0-a468-49f3dba4e91f tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:06.759766 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-59a63716-3f70-4ef0-a468-49f3dba4e91f tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:06.760268 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-59a63716-3f70-4ef0-a468-49f3dba4e91f tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:06.760981 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-59a63716-3f70-4ef0-a468-49f3dba4e91f tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:06.761596 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-59a63716-3f70-4ef0-a468-49f3dba4e91f tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:06.762010 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-59a63716-3f70-4ef0-a468-49f3dba4e91f tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:06.792231 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-59a63716-3f70-4ef0-a468-49f3dba4e91f tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] 10.222.0.20 "GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047631 Aug 09 02:45:06.792806 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 295/605] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 9 02:45:06 2022] GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:45:07.809108 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-92e54da7-fee0-4576-8723-184b087ced25 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:07.812602 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-92e54da7-fee0-4576-8723-184b087ced25 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] [instance: 7cfae5d5-8846-4c6d-8e56-5a52f817b48e] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:07.823443 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-92e54da7-fee0-4576-8723-184b087ced25 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:07.824252 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-92e54da7-fee0-4576-8723-184b087ced25 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:07.824678 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-92e54da7-fee0-4576-8723-184b087ced25 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:07.825353 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-92e54da7-fee0-4576-8723-184b087ced25 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:07.825793 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-92e54da7-fee0-4576-8723-184b087ced25 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:07.826223 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-92e54da7-fee0-4576-8723-184b087ced25 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:07.854269 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-92e54da7-fee0-4576-8723-184b087ced25 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] 10.222.0.20 "GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052070 Aug 09 02:45:07.854803 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 311/606] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 9 02:45:07 2022] GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 02:45:07.868369 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-1866d47b-05b7-4a68-b81a-208fea032f4a tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:07.868907 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-1866d47b-05b7-4a68-b81a-208fea032f4a tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] [instance: 7cfae5d5-8846-4c6d-8e56-5a52f817b48e] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:07.878453 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1866d47b-05b7-4a68-b81a-208fea032f4a tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:07.878933 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1866d47b-05b7-4a68-b81a-208fea032f4a tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:07.879433 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1866d47b-05b7-4a68-b81a-208fea032f4a tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:07.880450 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1866d47b-05b7-4a68-b81a-208fea032f4a tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:07.880944 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1866d47b-05b7-4a68-b81a-208fea032f4a tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:07.881486 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1866d47b-05b7-4a68-b81a-208fea032f4a tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:07.967442 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.wsgi [None req-1866d47b-05b7-4a68-b81a-208fea032f4a tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] HTTP exception thrown: Instance 7cfae5d5-8846-4c6d-8e56-5a52f817b48e is not attached to volume 0577e2d0-7dfe-44ea-8c32-cffd78a27ddf Aug 09 02:45:07.969871 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-1866d47b-05b7-4a68-b81a-208fea032f4a tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Request method failure captured: Aug 09 02:45:07.969871 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: request: DELETE /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e/os-volume_attachments/0577e2d0-7dfe-44ea-8c32-cffd78a27ddf HTTP/1.1 Aug 09 02:45:07.969871 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Accept: application/json Aug 09 02:45:07.969871 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Accept-Encoding: identity Aug 09 02:45:07.969871 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Connection: close Aug 09 02:45:07.969871 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Content-Length: 0 Aug 09 02:45:07.969871 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Content-Type: application/json Aug 09 02:45:07.969871 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Host: 10.222.0.20 Aug 09 02:45:07.969871 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Openstack-System-Scope: None Aug 09 02:45:07.969871 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: User-Agent: python-urllib3/1.26.11 Aug 09 02:45:07.969871 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Auth-Token: gAAAAABi8cliDldxxuTUKrjtPnolceiAL7cYSrFL-icqPMoz-Z1nkBFO5fqeYRRAND0nGjQKh4Tt94DGV0AqNEBLNpoL1wxaMNGdKI5Yjy4OYMM_jc-3m4E4LJLZxpUP0TYIQjtaq28kKXnfVGnSiQPfEm8-d5e_IbULmbvHG4EAgoEUn8gxvmc Aug 09 02:45:07.969871 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Domain-Id: None Aug 09 02:45:07.969871 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Domain-Name: None Aug 09 02:45:07.969871 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Identity-Status: Confirmed Aug 09 02:45:07.969871 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Is-Admin-Project: True Aug 09 02:45:07.969871 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Domain-Id: default Aug 09 02:45:07.969871 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Domain-Name: Default Aug 09 02:45:07.969871 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Id: f0a5508bdf5e4577b49783c3e424f1ee Aug 09 02:45:07.969871 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Name: tempest-TestMinimumBasicScenario-818344225 Aug 09 02:45:07.969871 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Role: reader,member Aug 09 02:45:07.969871 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Roles: reader,member Aug 09 02:45:07.971518 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f0a5508bdf5e4577b49783c3e424f1ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f0a5508bdf5e4577b49783c3e424f1ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f0a5508bdf5e4577b49783c3e424f1ee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f0a5508bdf5e4577b49783c3e424f1ee"}]}] Aug 09 02:45:07.971518 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant: tempest-TestMinimumBasicScenario-818344225 Aug 09 02:45:07.971518 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant-Id: f0a5508bdf5e4577b49783c3e424f1ee Aug 09 02:45:07.971518 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant-Name: tempest-TestMinimumBasicScenario-818344225 Aug 09 02:45:07.971518 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User: tempest-TestMinimumBasicScenario-818344225-project Aug 09 02:45:07.971518 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Domain-Id: default Aug 09 02:45:07.971518 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Domain-Name: Default Aug 09 02:45:07.971518 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Id: f6d6b64eb434414ab61f19b170385c3d Aug 09 02:45:07.971518 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Name: tempest-TestMinimumBasicScenario-818344225-project Aug 09 02:45:07.971518 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: method: > Aug 09 02:45:07.971518 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: exception: Instance 7cfae5d5-8846-4c6d-8e56-5a52f817b48e is not attached to volume 0577e2d0-7dfe-44ea-8c32-cffd78a27ddf Aug 09 02:45:07.972248 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: action_args: {'server_id': '7cfae5d5-8846-4c6d-8e56-5a52f817b48e', 'id': '0577e2d0-7dfe-44ea-8c32-cffd78a27ddf'} Aug 09 02:45:07.972248 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 02:45:07.972248 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:45:07.972248 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 09 02:45:07.972248 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 09 02:45:07.972248 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 02:45:07.972248 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 02:45:07.972248 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 09 02:45:07.972248 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 09 02:45:07.972248 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 0577e2d0-7dfe-44ea-8c32-cffd78a27ddf. Aug 09 02:45:07.972248 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:45:07.972248 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:45:07.972248 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:45:07.972248 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:45:07.972248 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:45:07.972248 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:45:07.972248 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 02:45:07.972248 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 02:45:07.972248 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 02:45:07.973431 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 02:45:07.973431 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 09 02:45:07.973431 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 09 02:45:07.973431 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cfae5d5-8846-4c6d-8e56-5a52f817b48e is not attached to volume 0577e2d0-7dfe-44ea-8c32-cffd78a27ddf Aug 09 02:45:07.973431 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:45:07.973431 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:45:07.973431 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:45:07.973431 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:45:07.973431 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:45:07.973431 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:45:07.973431 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 02:45:07.973431 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 02:45:07.973431 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cfae5d5-8846-4c6d-8e56-5a52f817b48e is not attached to volume 0577e2d0-7dfe-44ea-8c32-cffd78a27ddf Aug 09 02:45:07.973431 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:45:07.973431 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-1866d47b-05b7-4a68-b81a-208fea032f4a tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Returning 404 to user: Instance 7cfae5d5-8846-4c6d-8e56-5a52f817b48e is not attached to volume 0577e2d0-7dfe-44ea-8c32-cffd78a27ddf {{(pid=124425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 02:45:07.974317 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-1866d47b-05b7-4a68-b81a-208fea032f4a tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e/os-volume_attachments/0577e2d0-7dfe-44ea-8c32-cffd78a27ddf" status: 404 len: 154 microversion: 2.1 time: 0.109281 Aug 09 02:45:07.974317 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 296/607] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Aug 9 02:45:07 2022] DELETE /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e/os-volume_attachments/0577e2d0-7dfe-44ea-8c32-cffd78a27ddf => generated 154 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 02:45:09.122417 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-db121200-0fe9-4873-814d-ee5745a609fe tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:09.122996 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-db121200-0fe9-4873-814d-ee5745a609fe tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] [instance: 7cfae5d5-8846-4c6d-8e56-5a52f817b48e] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:09.129864 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-db121200-0fe9-4873-814d-ee5745a609fe tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:09.130376 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-db121200-0fe9-4873-814d-ee5745a609fe tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:09.130804 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-db121200-0fe9-4873-814d-ee5745a609fe tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:09.131485 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-db121200-0fe9-4873-814d-ee5745a609fe tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:09.131958 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-db121200-0fe9-4873-814d-ee5745a609fe tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:09.132376 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-db121200-0fe9-4873-814d-ee5745a609fe tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:09.157153 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-db121200-0fe9-4873-814d-ee5745a609fe tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] [instance: 7cfae5d5-8846-4c6d-8e56-5a52f817b48e] Going to try to terminate instance {{(pid=124427) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 02:45:09.234074 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-db121200-0fe9-4873-814d-ee5745a609fe tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e" status: 204 len: 0 microversion: 2.1 time: 0.115346 Aug 09 02:45:09.235038 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 312/608] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 9 02:45:09 2022] DELETE /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 02:45:09.243609 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-7b3ad24d-921e-46cd-ba55-65242fb28e84 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:09.244160 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-7b3ad24d-921e-46cd-ba55-65242fb28e84 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] [instance: 7cfae5d5-8846-4c6d-8e56-5a52f817b48e] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:09.250711 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7b3ad24d-921e-46cd-ba55-65242fb28e84 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:09.251212 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7b3ad24d-921e-46cd-ba55-65242fb28e84 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:09.251648 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7b3ad24d-921e-46cd-ba55-65242fb28e84 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:09.252333 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7b3ad24d-921e-46cd-ba55-65242fb28e84 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:09.252790 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7b3ad24d-921e-46cd-ba55-65242fb28e84 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:09.253203 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7b3ad24d-921e-46cd-ba55-65242fb28e84 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:09.394217 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-7b3ad24d-921e-46cd-ba55-65242fb28e84 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6b64eb434414ab61f19b170385c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5508bdf5e4577b49783c3e424f1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:09.404864 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-7b3ad24d-921e-46cd-ba55-65242fb28e84 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] 10.222.0.20 "GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e" status: 200 len: 1552 microversion: 2.1 time: 0.165433 Aug 09 02:45:09.405430 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 297/609] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:45:09 2022] GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e => generated 1552 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:45:10.431763 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-9fb01fd7-0e84-495b-b56f-f47431fb4fda tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:10.432901 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-9fb01fd7-0e84-495b-b56f-f47431fb4fda tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] [instance: 7cfae5d5-8846-4c6d-8e56-5a52f817b48e] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:10.441745 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9fb01fd7-0e84-495b-b56f-f47431fb4fda tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:10.442249 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9fb01fd7-0e84-495b-b56f-f47431fb4fda tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:10.442677 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9fb01fd7-0e84-495b-b56f-f47431fb4fda tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:10.443364 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9fb01fd7-0e84-495b-b56f-f47431fb4fda tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:10.443834 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9fb01fd7-0e84-495b-b56f-f47431fb4fda tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:10.444216 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9fb01fd7-0e84-495b-b56f-f47431fb4fda tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:10.585442 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-9fb01fd7-0e84-495b-b56f-f47431fb4fda tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6b64eb434414ab61f19b170385c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5508bdf5e4577b49783c3e424f1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:10.596866 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-9fb01fd7-0e84-495b-b56f-f47431fb4fda tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] 10.222.0.20 "GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e" status: 200 len: 1552 microversion: 2.1 time: 0.172137 Aug 09 02:45:10.597637 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 313/610] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:45:10 2022] GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e => generated 1552 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:45:11.622853 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-dbdc37b8-8812-4dee-ad13-2cff51bed9a2 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:11.623863 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-dbdc37b8-8812-4dee-ad13-2cff51bed9a2 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] [instance: 7cfae5d5-8846-4c6d-8e56-5a52f817b48e] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:11.631695 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-dbdc37b8-8812-4dee-ad13-2cff51bed9a2 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:11.632177 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-dbdc37b8-8812-4dee-ad13-2cff51bed9a2 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:11.632606 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-dbdc37b8-8812-4dee-ad13-2cff51bed9a2 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:11.633301 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-dbdc37b8-8812-4dee-ad13-2cff51bed9a2 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:11.633745 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-dbdc37b8-8812-4dee-ad13-2cff51bed9a2 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:11.634182 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-dbdc37b8-8812-4dee-ad13-2cff51bed9a2 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:11.872733 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-dbdc37b8-8812-4dee-ad13-2cff51bed9a2 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6b64eb434414ab61f19b170385c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5508bdf5e4577b49783c3e424f1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:11.880731 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-dbdc37b8-8812-4dee-ad13-2cff51bed9a2 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] 10.222.0.20 "GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e" status: 200 len: 1552 microversion: 2.1 time: 0.264395 Aug 09 02:45:11.881292 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 298/611] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:45:11 2022] GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e => generated 1552 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:45:12.147595 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [req-1d89b105-82f6-4572-98cd-2890ce96449c req-9e5d8b96-1495-4b02-a981-becf60d50ab4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cfae5d5-8846-4c6d-8e56-5a52f817b48e", "name": "network-vif-deleted", "tag": "e3bd4b2e-303f-4020-9be9-d72af9307f8a"}]} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:45:12.158963 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-1d89b105-82f6-4572-98cd-2890ce96449c req-9e5d8b96-1495-4b02-a981-becf60d50ab4 service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:12.159432 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-1d89b105-82f6-4572-98cd-2890ce96449c req-9e5d8b96-1495-4b02-a981-becf60d50ab4 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:12.159846 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-1d89b105-82f6-4572-98cd-2890ce96449c req-9e5d8b96-1495-4b02-a981-becf60d50ab4 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:12.171516 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.compute.server_external_events [req-1d89b105-82f6-4572-98cd-2890ce96449c req-9e5d8b96-1495-4b02-a981-becf60d50ab4 service nova] Creating event network-vif-deleted:e3bd4b2e-303f-4020-9be9-d72af9307f8a for instance 7cfae5d5-8846-4c6d-8e56-5a52f817b48e on hv-cinder-85246 Aug 09 02:45:12.176490 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [req-1d89b105-82f6-4572-98cd-2890ce96449c req-9e5d8b96-1495-4b02-a981-becf60d50ab4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032684 Aug 09 02:45:12.177089 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 314/612] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:45:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:45:12.906767 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-654fb682-d18b-4f14-be24-8b6e7f013bd1 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:12.907733 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-654fb682-d18b-4f14-be24-8b6e7f013bd1 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] [instance: 7cfae5d5-8846-4c6d-8e56-5a52f817b48e] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:12.918029 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-654fb682-d18b-4f14-be24-8b6e7f013bd1 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:12.918749 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-654fb682-d18b-4f14-be24-8b6e7f013bd1 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:12.919555 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-654fb682-d18b-4f14-be24-8b6e7f013bd1 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:12.920690 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-654fb682-d18b-4f14-be24-8b6e7f013bd1 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:12.921137 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-654fb682-d18b-4f14-be24-8b6e7f013bd1 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:12.921556 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-654fb682-d18b-4f14-be24-8b6e7f013bd1 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:12.934977 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.wsgi [None req-654fb682-d18b-4f14-be24-8b6e7f013bd1 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] HTTP exception thrown: Instance 7cfae5d5-8846-4c6d-8e56-5a52f817b48e could not be found. Aug 09 02:45:12.936507 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-654fb682-d18b-4f14-be24-8b6e7f013bd1 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Request method failure captured: Aug 09 02:45:12.936507 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: request: GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e HTTP/1.1 Aug 09 02:45:12.936507 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Accept: application/json Aug 09 02:45:12.936507 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Accept-Encoding: identity Aug 09 02:45:12.936507 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Connection: close Aug 09 02:45:12.936507 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Content-Length: 0 Aug 09 02:45:12.936507 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Content-Type: application/json Aug 09 02:45:12.936507 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Host: 10.222.0.20 Aug 09 02:45:12.936507 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Openstack-System-Scope: None Aug 09 02:45:12.936507 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: User-Agent: python-urllib3/1.26.11 Aug 09 02:45:12.936507 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Auth-Token: gAAAAABi8cliDldxxuTUKrjtPnolceiAL7cYSrFL-icqPMoz-Z1nkBFO5fqeYRRAND0nGjQKh4Tt94DGV0AqNEBLNpoL1wxaMNGdKI5Yjy4OYMM_jc-3m4E4LJLZxpUP0TYIQjtaq28kKXnfVGnSiQPfEm8-d5e_IbULmbvHG4EAgoEUn8gxvmc Aug 09 02:45:12.936507 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Domain-Id: None Aug 09 02:45:12.936507 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Domain-Name: None Aug 09 02:45:12.936507 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Identity-Status: Confirmed Aug 09 02:45:12.936507 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Is-Admin-Project: True Aug 09 02:45:12.936507 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Domain-Id: default Aug 09 02:45:12.936507 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Domain-Name: Default Aug 09 02:45:12.936507 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Id: f0a5508bdf5e4577b49783c3e424f1ee Aug 09 02:45:12.936507 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Name: tempest-TestMinimumBasicScenario-818344225 Aug 09 02:45:12.936507 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Role: reader,member Aug 09 02:45:12.936507 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Roles: reader,member Aug 09 02:45:12.938095 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f0a5508bdf5e4577b49783c3e424f1ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f0a5508bdf5e4577b49783c3e424f1ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f0a5508bdf5e4577b49783c3e424f1ee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f0a5508bdf5e4577b49783c3e424f1ee"}]}] Aug 09 02:45:12.938095 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant: tempest-TestMinimumBasicScenario-818344225 Aug 09 02:45:12.938095 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant-Id: f0a5508bdf5e4577b49783c3e424f1ee Aug 09 02:45:12.938095 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant-Name: tempest-TestMinimumBasicScenario-818344225 Aug 09 02:45:12.938095 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User: tempest-TestMinimumBasicScenario-818344225-project Aug 09 02:45:12.938095 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Domain-Id: default Aug 09 02:45:12.938095 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Domain-Name: Default Aug 09 02:45:12.938095 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Id: f6d6b64eb434414ab61f19b170385c3d Aug 09 02:45:12.938095 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Name: tempest-TestMinimumBasicScenario-818344225-project Aug 09 02:45:12.938095 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: method: > Aug 09 02:45:12.938095 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: exception: Instance 7cfae5d5-8846-4c6d-8e56-5a52f817b48e could not be found. Aug 09 02:45:12.938095 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: action_args: {'id': '7cfae5d5-8846-4c6d-8e56-5a52f817b48e'} Aug 09 02:45:12.939019 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 02:45:12.939019 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:45:12.939019 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 02:45:12.939019 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 02:45:12.939019 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 02:45:12.939019 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 02:45:12.939019 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 02:45:12.939019 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 02:45:12.939019 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 02:45:12.939019 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 02:45:12.939019 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cfae5d5-8846-4c6d-8e56-5a52f817b48e could not be found. Aug 09 02:45:12.939019 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:45:12.939019 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:45:12.939019 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:45:12.939019 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:45:12.939019 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:45:12.939019 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:45:12.939019 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 02:45:12.939019 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 02:45:12.939019 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 02:45:12.940295 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 02:45:12.940295 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 02:45:12.940295 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 02:45:12.940295 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 02:45:12.940295 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 02:45:12.940295 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 02:45:12.940295 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 02:45:12.940295 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cfae5d5-8846-4c6d-8e56-5a52f817b48e could not be found. Aug 09 02:45:12.940295 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:45:12.940295 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:45:12.940295 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:45:12.940295 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:45:12.940295 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:45:12.940295 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:45:12.940295 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 02:45:12.940295 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 02:45:12.940295 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cfae5d5-8846-4c6d-8e56-5a52f817b48e could not be found. Aug 09 02:45:12.940295 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:45:12.941427 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-654fb682-d18b-4f14-be24-8b6e7f013bd1 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Returning 404 to user: Instance 7cfae5d5-8846-4c6d-8e56-5a52f817b48e could not be found. {{(pid=124425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 02:45:12.941427 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-654fb682-d18b-4f14-be24-8b6e7f013bd1 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] 10.222.0.20 "GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e" status: 404 len: 111 microversion: 2.1 time: 0.038169 Aug 09 02:45:12.941427 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 299/613] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:45:12 2022] GET /compute/v2.1/servers/7cfae5d5-8846-4c6d-8e56-5a52f817b48e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 02:45:12.947484 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-939d8cdb-3039-44cf-8c10-33a830b9b560 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] Calling method '.version_select at 0x7fb0a02ef310>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:12.970148 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-939d8cdb-3039-44cf-8c10-33a830b9b560 tempest-TestMinimumBasicScenario-818344225 tempest-TestMinimumBasicScenario-818344225-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-523919105" status: 202 len: 0 microversion: 2.1 time: 0.026948 Aug 09 02:45:12.970786 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 315/614] 10.222.0.20 () {58 vars in 1269 bytes} [Tue Aug 9 02:45:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-523919105 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 02:45:16.862405 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-64b72918-c0d4-4ba8-9338-731f520ee69f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:16.864739 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-64b72918-c0d4-4ba8-9338-731f520ee69f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:16.871712 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-64b72918-c0d4-4ba8-9338-731f520ee69f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:16.872202 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-64b72918-c0d4-4ba8-9338-731f520ee69f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:16.872630 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-64b72918-c0d4-4ba8-9338-731f520ee69f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:16.873328 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-64b72918-c0d4-4ba8-9338-731f520ee69f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:16.873891 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-64b72918-c0d4-4ba8-9338-731f520ee69f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:16.874323 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-64b72918-c0d4-4ba8-9338-731f520ee69f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:16.903881 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-64b72918-c0d4-4ba8-9338-731f520ee69f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045904 Aug 09 02:45:16.904668 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 300/615] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 9 02:45:16 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 02:45:16.968253 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-8551b6d4-b0fa-4e16-8c26-63883493a502 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:16.968822 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-8551b6d4-b0fa-4e16-8c26-63883493a502 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:16.975972 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8551b6d4-b0fa-4e16-8c26-63883493a502 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:16.976455 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8551b6d4-b0fa-4e16-8c26-63883493a502 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:16.976862 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8551b6d4-b0fa-4e16-8c26-63883493a502 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:16.977584 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8551b6d4-b0fa-4e16-8c26-63883493a502 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:16.978032 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8551b6d4-b0fa-4e16-8c26-63883493a502 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:16.978475 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8551b6d4-b0fa-4e16-8c26-63883493a502 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:17.005493 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-8551b6d4-b0fa-4e16-8c26-63883493a502 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Going to try to terminate instance {{(pid=124427) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 02:45:17.084734 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-8551b6d4-b0fa-4e16-8c26-63883493a502 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 204 len: 0 microversion: 2.1 time: 0.121031 Aug 09 02:45:17.085550 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 316/616] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 9 02:45:16 2022] DELETE /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 02:45:17.094227 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-21ba12d9-63c2-4076-b19c-a692fef689d2 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:17.096021 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-21ba12d9-63c2-4076-b19c-a692fef689d2 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:17.102547 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-21ba12d9-63c2-4076-b19c-a692fef689d2 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:17.103241 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-21ba12d9-63c2-4076-b19c-a692fef689d2 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:17.103676 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-21ba12d9-63c2-4076-b19c-a692fef689d2 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:17.104406 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-21ba12d9-63c2-4076-b19c-a692fef689d2 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:17.104850 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-21ba12d9-63c2-4076-b19c-a692fef689d2 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:17.105418 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-21ba12d9-63c2-4076-b19c-a692fef689d2 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:17.242346 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-21ba12d9-63c2-4076-b19c-a692fef689d2 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:17.250559 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-21ba12d9-63c2-4076-b19c-a692fef689d2 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 200 len: 1672 microversion: 2.1 time: 0.160384 Aug 09 02:45:17.251122 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 301/617] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:45:17 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 1672 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:45:18.272997 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-0261f606-70e9-4af2-bd14-5b0bb3823d96 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:18.274464 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-0261f606-70e9-4af2-bd14-5b0bb3823d96 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:18.281154 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0261f606-70e9-4af2-bd14-5b0bb3823d96 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:18.281722 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0261f606-70e9-4af2-bd14-5b0bb3823d96 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:18.282315 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0261f606-70e9-4af2-bd14-5b0bb3823d96 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:18.283083 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0261f606-70e9-4af2-bd14-5b0bb3823d96 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:18.283589 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0261f606-70e9-4af2-bd14-5b0bb3823d96 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:18.284097 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0261f606-70e9-4af2-bd14-5b0bb3823d96 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:18.461488 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-0261f606-70e9-4af2-bd14-5b0bb3823d96 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:18.469551 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-0261f606-70e9-4af2-bd14-5b0bb3823d96 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 200 len: 1672 microversion: 2.1 time: 0.200935 Aug 09 02:45:18.470234 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 317/618] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:45:18 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 1672 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:45:19.494490 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-7880052b-1af5-4b34-a554-16c382601a3f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:19.495908 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-7880052b-1af5-4b34-a554-16c382601a3f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:19.502783 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7880052b-1af5-4b34-a554-16c382601a3f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:19.503508 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7880052b-1af5-4b34-a554-16c382601a3f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:19.503938 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7880052b-1af5-4b34-a554-16c382601a3f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:19.506086 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7880052b-1af5-4b34-a554-16c382601a3f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:19.508211 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7880052b-1af5-4b34-a554-16c382601a3f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:19.508211 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7880052b-1af5-4b34-a554-16c382601a3f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:19.513245 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-2e43a2cc-6d33-4338-a757-2a3287a5f9e1 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:19.514577 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-2e43a2cc-6d33-4338-a757-2a3287a5f9e1 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 3cda6c0b-68ff-41dd-aa38-48cbafba8451] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:19.521029 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:45:19.522946 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2e43a2cc-6d33-4338-a757-2a3287a5f9e1 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:19.523429 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2e43a2cc-6d33-4338-a757-2a3287a5f9e1 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:19.524406 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2e43a2cc-6d33-4338-a757-2a3287a5f9e1 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:19.524892 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2e43a2cc-6d33-4338-a757-2a3287a5f9e1 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:19.527301 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2e43a2cc-6d33-4338-a757-2a3287a5f9e1 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:19.527734 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2e43a2cc-6d33-4338-a757-2a3287a5f9e1 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:19.556277 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-2e43a2cc-6d33-4338-a757-2a3287a5f9e1 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/3cda6c0b-68ff-41dd-aa38-48cbafba8451/ips" status: 200 len: 150 microversion: 2.1 time: 0.046855 Aug 09 02:45:19.556861 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 318/619] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Aug 9 02:45:19 2022] GET /compute/v2.1/servers/3cda6c0b-68ff-41dd-aa38-48cbafba8451/ips => generated 150 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:45:19.686608 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-7880052b-1af5-4b34-a554-16c382601a3f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:19.695340 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-7880052b-1af5-4b34-a554-16c382601a3f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 200 len: 1672 microversion: 2.1 time: 0.206823 Aug 09 02:45:19.696214 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 302/620] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:45:19 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 1672 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:45:20.658324 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [req-8812f92a-2313-4ff2-b3ab-386f077f3bde req-969d3876-ecb9-4fb3-917a-3eea7776c666 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f16a110-9dc8-4e95-b6de-c30feee35b89", "name": "network-vif-deleted", "tag": "e1bca63c-8e79-4219-8848-c50bf228ba03"}]} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:45:20.669523 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-8812f92a-2313-4ff2-b3ab-386f077f3bde req-969d3876-ecb9-4fb3-917a-3eea7776c666 service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:20.670762 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-8812f92a-2313-4ff2-b3ab-386f077f3bde req-969d3876-ecb9-4fb3-917a-3eea7776c666 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:20.671260 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-8812f92a-2313-4ff2-b3ab-386f077f3bde req-969d3876-ecb9-4fb3-917a-3eea7776c666 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:20.683570 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.compute.server_external_events [req-8812f92a-2313-4ff2-b3ab-386f077f3bde req-969d3876-ecb9-4fb3-917a-3eea7776c666 service nova] Creating event network-vif-deleted:e1bca63c-8e79-4219-8848-c50bf228ba03 for instance 8f16a110-9dc8-4e95-b6de-c30feee35b89 on hv-cinder-85246 Aug 09 02:45:20.688503 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [req-8812f92a-2313-4ff2-b3ab-386f077f3bde req-969d3876-ecb9-4fb3-917a-3eea7776c666 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034138 Aug 09 02:45:20.689415 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 319/621] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:45:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:45:20.720721 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-fce349a4-ae00-4476-8a5a-8e634d20cc7e tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:20.721246 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-fce349a4-ae00-4476-8a5a-8e634d20cc7e tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:20.728992 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-fce349a4-ae00-4476-8a5a-8e634d20cc7e tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:20.729958 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-fce349a4-ae00-4476-8a5a-8e634d20cc7e tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:20.730422 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-fce349a4-ae00-4476-8a5a-8e634d20cc7e tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:20.731126 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-fce349a4-ae00-4476-8a5a-8e634d20cc7e tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:20.731576 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-fce349a4-ae00-4476-8a5a-8e634d20cc7e tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:20.736260 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-fce349a4-ae00-4476-8a5a-8e634d20cc7e tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:20.837447 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-fce349a4-ae00-4476-8a5a-8e634d20cc7e tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:20.847266 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-fce349a4-ae00-4476-8a5a-8e634d20cc7e tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 200 len: 1322 microversion: 2.1 time: 0.131098 Aug 09 02:45:20.862807 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 303/622] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:45:20 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 1322 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:45:21.012472 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-f365595a-fc7b-4b2e-83d6-6dc3bb20f867 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d35735a5-249b-4872-9423-18b9ca88a305"}} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:45:21.016042 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-f365595a-fc7b-4b2e-83d6-6dc3bb20f867 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 3cda6c0b-68ff-41dd-aa38-48cbafba8451] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:21.022797 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-f365595a-fc7b-4b2e-83d6-6dc3bb20f867 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:21.023443 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-f365595a-fc7b-4b2e-83d6-6dc3bb20f867 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:21.023880 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-f365595a-fc7b-4b2e-83d6-6dc3bb20f867 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:21.024623 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-f365595a-fc7b-4b2e-83d6-6dc3bb20f867 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:21.025062 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-f365595a-fc7b-4b2e-83d6-6dc3bb20f867 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:21.025471 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-f365595a-fc7b-4b2e-83d6-6dc3bb20f867 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:21.413512 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-f365595a-fc7b-4b2e-83d6-6dc3bb20f867 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "POST /compute/v2.1/servers/3cda6c0b-68ff-41dd-aa38-48cbafba8451/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.405428 Aug 09 02:45:21.419366 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 320/623] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Aug 9 02:45:21 2022] POST /compute/v2.1/servers/3cda6c0b-68ff-41dd-aa38-48cbafba8451/os-volume_attachments => generated 194 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:45:21.872025 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-78f00921-d9ae-4dce-a278-390816464317 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:21.872883 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-78f00921-d9ae-4dce-a278-390816464317 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:21.883666 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-78f00921-d9ae-4dce-a278-390816464317 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:21.884422 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-78f00921-d9ae-4dce-a278-390816464317 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:21.884901 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-78f00921-d9ae-4dce-a278-390816464317 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:21.886006 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-78f00921-d9ae-4dce-a278-390816464317 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:21.886804 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-78f00921-d9ae-4dce-a278-390816464317 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:21.887495 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-78f00921-d9ae-4dce-a278-390816464317 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:21.901878 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.wsgi [None req-78f00921-d9ae-4dce-a278-390816464317 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] HTTP exception thrown: Instance 8f16a110-9dc8-4e95-b6de-c30feee35b89 could not be found. Aug 09 02:45:21.903448 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-78f00921-d9ae-4dce-a278-390816464317 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Request method failure captured: Aug 09 02:45:21.903448 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: request: GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 HTTP/1.1 Aug 09 02:45:21.903448 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Accept: application/json Aug 09 02:45:21.903448 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Accept-Encoding: identity Aug 09 02:45:21.903448 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Connection: close Aug 09 02:45:21.903448 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Content-Length: 0 Aug 09 02:45:21.903448 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Content-Type: application/json Aug 09 02:45:21.903448 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Host: 10.222.0.20 Aug 09 02:45:21.903448 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Openstack-System-Scope: None Aug 09 02:45:21.903448 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: User-Agent: python-urllib3/1.26.11 Aug 09 02:45:21.903448 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Auth-Token: gAAAAABi8ckyQ7BoJhOISZ_aEyRwvtOf6wBg9xUi9Vu7KodpYSACalrsvz2rvL1C_mIOt-qr3Bi3jUgZqn7iqf0560XT8zZG6jy4ZTCN9qg5QZL2v5rqXFvpy1e6ziUjE1jR1eQoZ7H0yZm_ukrqaTXnceGFTdwFzKa-RsIlRVyuWjAiXqqozsE Aug 09 02:45:21.903448 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Domain-Id: None Aug 09 02:45:21.903448 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Domain-Name: None Aug 09 02:45:21.903448 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Identity-Status: Confirmed Aug 09 02:45:21.903448 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Is-Admin-Project: True Aug 09 02:45:21.903448 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Domain-Id: default Aug 09 02:45:21.903448 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Domain-Name: Default Aug 09 02:45:21.903448 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Id: 467b42c2bec74fcbbf90d007a6e00096 Aug 09 02:45:21.903448 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Name: tempest-AttachVolumeTestJSON-1583791890 Aug 09 02:45:21.903448 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Role: reader,member Aug 09 02:45:21.903448 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Roles: reader,member Aug 09 02:45:21.905206 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/467b42c2bec74fcbbf90d007a6e00096"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/467b42c2bec74fcbbf90d007a6e00096"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_467b42c2bec74fcbbf90d007a6e00096"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/467b42c2bec74fcbbf90d007a6e00096"}]}] Aug 09 02:45:21.905206 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant: tempest-AttachVolumeTestJSON-1583791890 Aug 09 02:45:21.905206 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant-Id: 467b42c2bec74fcbbf90d007a6e00096 Aug 09 02:45:21.905206 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1583791890 Aug 09 02:45:21.905206 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User: tempest-AttachVolumeTestJSON-1583791890-project Aug 09 02:45:21.905206 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Domain-Id: default Aug 09 02:45:21.905206 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Domain-Name: Default Aug 09 02:45:21.905206 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Id: 2aaa8a7f386e4ccc9ab5c356cdf1704f Aug 09 02:45:21.905206 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Name: tempest-AttachVolumeTestJSON-1583791890-project Aug 09 02:45:21.905206 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: method: > Aug 09 02:45:21.905206 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: exception: Instance 8f16a110-9dc8-4e95-b6de-c30feee35b89 could not be found. Aug 09 02:45:21.905206 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: action_args: {'id': '8f16a110-9dc8-4e95-b6de-c30feee35b89'} Aug 09 02:45:21.906120 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 02:45:21.906120 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:45:21.906120 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 02:45:21.906120 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 02:45:21.906120 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 02:45:21.906120 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 02:45:21.906120 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 02:45:21.906120 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 02:45:21.906120 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 02:45:21.906120 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 02:45:21.906120 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f16a110-9dc8-4e95-b6de-c30feee35b89 could not be found. Aug 09 02:45:21.906120 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:45:21.906120 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:45:21.906120 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:45:21.906120 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:45:21.906120 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:45:21.906120 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:45:21.906120 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 02:45:21.906120 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 02:45:21.906120 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 02:45:21.908268 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 02:45:21.908268 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 02:45:21.908268 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 02:45:21.908268 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 02:45:21.908268 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 02:45:21.908268 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 02:45:21.908268 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 02:45:21.908268 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f16a110-9dc8-4e95-b6de-c30feee35b89 could not be found. Aug 09 02:45:21.908268 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:45:21.908268 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:45:21.908268 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:45:21.908268 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:45:21.908268 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:45:21.908268 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:45:21.908268 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 02:45:21.908268 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 02:45:21.908268 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f16a110-9dc8-4e95-b6de-c30feee35b89 could not be found. Aug 09 02:45:21.908268 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:45:21.909922 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-78f00921-d9ae-4dce-a278-390816464317 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Returning 404 to user: Instance 8f16a110-9dc8-4e95-b6de-c30feee35b89 could not be found. {{(pid=124425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 02:45:21.909922 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-78f00921-d9ae-4dce-a278-390816464317 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 404 len: 111 microversion: 2.1 time: 0.039281 Aug 09 02:45:21.909922 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 304/624] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:45:21 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 02:45:21.916847 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-949c9112-4e7b-439f-8488-b0f5378c6cf5 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '.version_select at 0x7fb0a02efe50>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:21.937850 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-949c9112-4e7b-439f-8488-b0f5378c6cf5 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-132344174" status: 202 len: 0 microversion: 2.1 time: 0.026167 Aug 09 02:45:21.938444 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 321/625] 10.222.0.20 () {58 vars in 1218 bytes} [Tue Aug 9 02:45:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-132344174 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 02:45:22.578008 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-0db6629b-23e5-46f0-bdaf-5a85bb363ca1 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Action: 'create', calling method: .version_select at 0x7fb0a03ea9d0>, body: {"keypair": {"name": "tempest-keypair-433822673", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFcjXSY3wdv5wFEvjKDGWpin1ieJC43OywauRRKVZsmngS3n1O8C9abRTKQX7w/0YeenX+8sM6xVm2FRmJyiwxDogcvPhyWTLTw7phGAv2TOIDuK1FMzVuflGSySsi4GYA=="}} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:45:22.593787 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.quota [None req-0db6629b-23e5-46f0-bdaf-5a85bb363ca1 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Getting quotas for project 467b42c2bec74fcbbf90d007a6e00096. Resources: {'key_pairs'} {{(pid=124425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 02:45:22.597671 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.quota [None req-0db6629b-23e5-46f0-bdaf-5a85bb363ca1 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Getting quotas for user 2aaa8a7f386e4ccc9ab5c356cdf1704f and project 467b42c2bec74fcbbf90d007a6e00096. Resources: {'key_pairs'} {{(pid=124425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 02:45:22.622666 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-0db6629b-23e5-46f0-bdaf-5a85bb363ca1 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048550 Aug 09 02:45:22.623242 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 305/626] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Aug 9 02:45:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:45:23.938195 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-dd04eca2-b9bd-4332-8170-e59f40699e71 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1942343035", "imageRef": "04a06944-b2a8-4a65-b2a6-7ed3ff18a627", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "92ed22b9-a5d1-438e-b0d0-2a9c0988d349"}], "security_groups": [{"name": "tempest-securitygroup--240202982"}], "key_name": "tempest-keypair-433822673", "user_data": "}} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:45:24.043078 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.network.neutron [None req-dd04eca2-b9bd-4332-8170-e59f40699e71 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] validate_networks() for [('92ed22b9-a5d1-438e-b0d0-2a9c0988d349', None, None, None, None, None)] {{(pid=124427) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 02:45:24.648266 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.virt.hardware [None req-dd04eca2-b9bd-4332-8170-e59f40699e71 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Flavor limits 0:0:0 {{(pid=124427) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 02:45:24.648847 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.virt.hardware [None req-dd04eca2-b9bd-4332-8170-e59f40699e71 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Image limits 0:0:0 {{(pid=124427) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 02:45:24.649334 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.virt.hardware [None req-dd04eca2-b9bd-4332-8170-e59f40699e71 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Flavor pref 0:0:0 {{(pid=124427) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 02:45:24.649737 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.virt.hardware [None req-dd04eca2-b9bd-4332-8170-e59f40699e71 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Image pref 0:0:0 {{(pid=124427) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 02:45:24.650467 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.virt.hardware [None req-dd04eca2-b9bd-4332-8170-e59f40699e71 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124427) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 02:45:24.659633 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-dd04eca2-b9bd-4332-8170-e59f40699e71 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:24.660118 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-dd04eca2-b9bd-4332-8170-e59f40699e71 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:24.660550 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-dd04eca2-b9bd-4332-8170-e59f40699e71 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:24.661269 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-dd04eca2-b9bd-4332-8170-e59f40699e71 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:24.661709 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-dd04eca2-b9bd-4332-8170-e59f40699e71 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:24.662120 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-dd04eca2-b9bd-4332-8170-e59f40699e71 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:24.679821 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.quota [None req-dd04eca2-b9bd-4332-8170-e59f40699e71 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Getting quotas for project 467b42c2bec74fcbbf90d007a6e00096. Resources: {'cores', 'ram', 'instances'} {{(pid=124427) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 02:45:24.683855 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.quota [None req-dd04eca2-b9bd-4332-8170-e59f40699e71 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Getting quotas for user 2aaa8a7f386e4ccc9ab5c356cdf1704f and project 467b42c2bec74fcbbf90d007a6e00096. Resources: {'cores', 'ram', 'instances'} {{(pid=124427) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 02:45:24.694644 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-dd04eca2-b9bd-4332-8170-e59f40699e71 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Going to run 1 instances... {{(pid=124427) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 02:45:24.697012 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-dd04eca2-b9bd-4332-8170-e59f40699e71 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: ac4668e2-6e51-4087-bfca-a22cff3b147f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='04a06944-b2a8-4a65-b2a6-7ed3ff18a627',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124427) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 02:45:24.743857 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-dd04eca2-b9bd-4332-8170-e59f40699e71 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.810701 Aug 09 02:45:24.749841 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 322/627] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Aug 9 02:45:23 2022] POST /compute/v2.1/servers => generated 401 bytes in 812 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 02:45:24.755473 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-0acb1d60-d822-4baa-beab-f2d27f90b835 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:24.756191 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-0acb1d60-d822-4baa-beab-f2d27f90b835 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: ac4668e2-6e51-4087-bfca-a22cff3b147f] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:24.812480 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-0acb1d60-d822-4baa-beab-f2d27f90b835 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:24.822814 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-0acb1d60-d822-4baa-beab-f2d27f90b835 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f" status: 200 len: 1237 microversion: 2.1 time: 0.071138 Aug 09 02:45:24.823529 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 306/628] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:45:24 2022] GET /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f => generated 1237 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:45:25.844583 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-184b254d-700e-491d-a799-893f30c0c171 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:25.845206 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-184b254d-700e-491d-a799-893f30c0c171 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: ac4668e2-6e51-4087-bfca-a22cff3b147f] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:25.851600 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-184b254d-700e-491d-a799-893f30c0c171 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:25.852081 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-184b254d-700e-491d-a799-893f30c0c171 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:25.852513 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-184b254d-700e-491d-a799-893f30c0c171 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:25.853208 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-184b254d-700e-491d-a799-893f30c0c171 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:25.853660 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-184b254d-700e-491d-a799-893f30c0c171 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:25.854080 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-184b254d-700e-491d-a799-893f30c0c171 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:26.089586 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-184b254d-700e-491d-a799-893f30c0c171 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:26.097384 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-184b254d-700e-491d-a799-893f30c0c171 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f" status: 200 len: 1297 microversion: 2.1 time: 0.257439 Aug 09 02:45:26.097967 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 323/629] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:45:25 2022] GET /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f => generated 1297 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:45:27.118813 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-8537bb3a-8b53-4800-86d5-838406c88143 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:27.119430 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-8537bb3a-8b53-4800-86d5-838406c88143 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: ac4668e2-6e51-4087-bfca-a22cff3b147f] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:27.126490 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8537bb3a-8b53-4800-86d5-838406c88143 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:27.126974 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8537bb3a-8b53-4800-86d5-838406c88143 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:27.127525 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8537bb3a-8b53-4800-86d5-838406c88143 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:27.128217 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8537bb3a-8b53-4800-86d5-838406c88143 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:27.128663 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8537bb3a-8b53-4800-86d5-838406c88143 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:27.129052 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8537bb3a-8b53-4800-86d5-838406c88143 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:27.341904 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-8537bb3a-8b53-4800-86d5-838406c88143 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:27.350191 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-8537bb3a-8b53-4800-86d5-838406c88143 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f" status: 200 len: 1362 microversion: 2.1 time: 0.235218 Aug 09 02:45:27.350836 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 307/630] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:45:27 2022] GET /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f => generated 1362 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:45:27.453172 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [req-d1f5d9bc-a783-4b32-828f-3011a5488f0c req-742da611-92c3-467f-8aed-159dde5838e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac4668e2-6e51-4087-bfca-a22cff3b147f", "tag": "134cb462-1c0a-49ec-94c5-16a7d99add24"}]} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:45:27.463236 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-d1f5d9bc-a783-4b32-828f-3011a5488f0c req-742da611-92c3-467f-8aed-159dde5838e5 service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:27.463674 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-d1f5d9bc-a783-4b32-828f-3011a5488f0c req-742da611-92c3-467f-8aed-159dde5838e5 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:27.464097 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-d1f5d9bc-a783-4b32-828f-3011a5488f0c req-742da611-92c3-467f-8aed-159dde5838e5 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:27.476883 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.compute.server_external_events [req-d1f5d9bc-a783-4b32-828f-3011a5488f0c req-742da611-92c3-467f-8aed-159dde5838e5 service nova] Creating event network-changed:134cb462-1c0a-49ec-94c5-16a7d99add24 for instance ac4668e2-6e51-4087-bfca-a22cff3b147f on hv-cinder-85246 Aug 09 02:45:27.481710 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [req-d1f5d9bc-a783-4b32-828f-3011a5488f0c req-742da611-92c3-467f-8aed-159dde5838e5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032340 Aug 09 02:45:27.482307 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 324/631] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:45:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 02:45:28.372882 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-b9173183-68cc-4e2e-828f-15f435d665d4 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:28.373450 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-b9173183-68cc-4e2e-828f-15f435d665d4 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: ac4668e2-6e51-4087-bfca-a22cff3b147f] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:28.380879 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b9173183-68cc-4e2e-828f-15f435d665d4 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:28.381357 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b9173183-68cc-4e2e-828f-15f435d665d4 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:28.381784 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b9173183-68cc-4e2e-828f-15f435d665d4 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:28.382507 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b9173183-68cc-4e2e-828f-15f435d665d4 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:28.382938 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b9173183-68cc-4e2e-828f-15f435d665d4 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:28.383352 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b9173183-68cc-4e2e-828f-15f435d665d4 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:28.692859 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-b9173183-68cc-4e2e-828f-15f435d665d4 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:28.700672 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-b9173183-68cc-4e2e-828f-15f435d665d4 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f" status: 200 len: 1362 microversion: 2.1 time: 0.332634 Aug 09 02:45:28.701247 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 308/632] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:45:28 2022] GET /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f => generated 1362 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:45:28.998201 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-512d6fae-0bbe-44a6-8543-e7d685ef126f tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d35735a5-249b-4872-9423-18b9ca88a305"}} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:45:29.000803 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-512d6fae-0bbe-44a6-8543-e7d685ef126f tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 3cda6c0b-68ff-41dd-aa38-48cbafba8451] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:29.007545 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-512d6fae-0bbe-44a6-8543-e7d685ef126f tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:29.008059 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-512d6fae-0bbe-44a6-8543-e7d685ef126f tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:29.008449 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-512d6fae-0bbe-44a6-8543-e7d685ef126f tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:29.009186 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-512d6fae-0bbe-44a6-8543-e7d685ef126f tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:29.009626 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-512d6fae-0bbe-44a6-8543-e7d685ef126f tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:29.010024 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-512d6fae-0bbe-44a6-8543-e7d685ef126f tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:29.090525 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.wsgi [None req-512d6fae-0bbe-44a6-8543-e7d685ef126f tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] HTTP exception thrown: Invalid volume: volume d35735a5-249b-4872-9423-18b9ca88a305 is already attached to instances: 3cda6c0b-68ff-41dd-aa38-48cbafba8451 Aug 09 02:45:29.092221 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-512d6fae-0bbe-44a6-8543-e7d685ef126f tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Request method failure captured: Aug 09 02:45:29.092221 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: request: POST /compute/v2.1/servers/3cda6c0b-68ff-41dd-aa38-48cbafba8451/os-volume_attachments HTTP/1.1 Aug 09 02:45:29.092221 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Accept: application/json Aug 09 02:45:29.092221 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Accept-Encoding: identity Aug 09 02:45:29.092221 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Connection: close Aug 09 02:45:29.092221 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Content-Length: 74 Aug 09 02:45:29.092221 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Content-Type: application/json Aug 09 02:45:29.092221 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Host: 10.222.0.20 Aug 09 02:45:29.092221 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Openstack-System-Scope: None Aug 09 02:45:29.092221 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: User-Agent: python-urllib3/1.26.11 Aug 09 02:45:29.092221 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Auth-Token: gAAAAABi8ckjyQvMSPVjOXRhh70Rnc1ANMFv7G7JLArfSACfDLzvvcneDlsL-sI9hF681zwEIODxGFE7k1OsPJO-SGVxluvBNMmaFLG_fx-H9D1ZvGPLVeuDO_toy5qwJovkKz9pwj7m5cniNs8yMlVJKkLfQNx_gl4pQZFRtesItHh6k1DiYvw Aug 09 02:45:29.092221 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Domain-Id: None Aug 09 02:45:29.092221 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Domain-Name: None Aug 09 02:45:29.092221 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Identity-Status: Confirmed Aug 09 02:45:29.092221 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Is-Admin-Project: True Aug 09 02:45:29.092221 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Domain-Id: default Aug 09 02:45:29.092221 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Domain-Name: Default Aug 09 02:45:29.092221 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Id: 8ce26c854fc24cadb2be5ebd441b8f3a Aug 09 02:45:29.092221 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Name: tempest-AttachVolumeNegativeTest-1568455203 Aug 09 02:45:29.092221 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Role: reader,member Aug 09 02:45:29.092221 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Roles: reader,member Aug 09 02:45:29.093611 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8ce26c854fc24cadb2be5ebd441b8f3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8ce26c854fc24cadb2be5ebd441b8f3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8ce26c854fc24cadb2be5ebd441b8f3a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8ce26c854fc24cadb2be5ebd441b8f3a"}]}] Aug 09 02:45:29.093611 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant: tempest-AttachVolumeNegativeTest-1568455203 Aug 09 02:45:29.093611 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant-Id: 8ce26c854fc24cadb2be5ebd441b8f3a Aug 09 02:45:29.093611 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1568455203 Aug 09 02:45:29.093611 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User: tempest-AttachVolumeNegativeTest-1568455203-project Aug 09 02:45:29.093611 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Domain-Id: default Aug 09 02:45:29.093611 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Domain-Name: Default Aug 09 02:45:29.093611 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Id: 43232b9b191047f9a3e6ebab7ad36f02 Aug 09 02:45:29.093611 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Name: tempest-AttachVolumeNegativeTest-1568455203-project Aug 09 02:45:29.093611 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Aug 09 02:45:29.093611 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: {"volumeAttachment": {"volumeId": "d35735a5-249b-4872-9423-18b9ca88a305"}} Aug 09 02:45:29.093611 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: method: > Aug 09 02:45:29.094787 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: exception: Invalid volume: volume d35735a5-249b-4872-9423-18b9ca88a305 is already attached to instances: 3cda6c0b-68ff-41dd-aa38-48cbafba8451 Aug 09 02:45:29.094787 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: action_args: {'server_id': '3cda6c0b-68ff-41dd-aa38-48cbafba8451', 'body': {'volumeAttachment': {'volumeId': 'd35735a5-249b-4872-9423-18b9ca88a305'}}} Aug 09 02:45:29.094787 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 02:45:29.094787 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:45:29.094787 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 09 02:45:29.094787 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 09 02:45:29.094787 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 02:45:29.094787 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 02:45:29.094787 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 09 02:45:29.094787 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 09 02:45:29.094787 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 09 02:45:29.094787 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 09 02:45:29.094787 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 09 02:45:29.094787 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 09 02:45:29.094787 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d35735a5-249b-4872-9423-18b9ca88a305 is already attached to instances: 3cda6c0b-68ff-41dd-aa38-48cbafba8451 Aug 09 02:45:29.094787 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:45:29.094787 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:45:29.094787 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:45:29.094787 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:45:29.095985 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:45:29.095985 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:45:29.095985 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 02:45:29.095985 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 02:45:29.095985 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 02:45:29.095985 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 02:45:29.095985 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 02:45:29.095985 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 02:45:29.095985 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 02:45:29.095985 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 02:45:29.095985 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 02:45:29.095985 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 02:45:29.095985 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 09 02:45:29.095985 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 09 02:45:29.095985 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d35735a5-249b-4872-9423-18b9ca88a305 is already attached to instances: 3cda6c0b-68ff-41dd-aa38-48cbafba8451 Aug 09 02:45:29.095985 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:45:29.095985 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:45:29.095985 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:45:29.095985 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:45:29.095985 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:45:29.097255 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:45:29.097255 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 02:45:29.097255 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 02:45:29.097255 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d35735a5-249b-4872-9423-18b9ca88a305 is already attached to instances: 3cda6c0b-68ff-41dd-aa38-48cbafba8451 Aug 09 02:45:29.097255 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:45:29.097255 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-512d6fae-0bbe-44a6-8543-e7d685ef126f tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Returning 400 to user: Invalid volume: volume d35735a5-249b-4872-9423-18b9ca88a305 is already attached to instances: 3cda6c0b-68ff-41dd-aa38-48cbafba8451 {{(pid=124427) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 02:45:29.097255 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-512d6fae-0bbe-44a6-8543-e7d685ef126f tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "POST /compute/v2.1/servers/3cda6c0b-68ff-41dd-aa38-48cbafba8451/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099869 Aug 09 02:45:29.097255 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 325/633] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Aug 9 02:45:28 2022] POST /compute/v2.1/servers/3cda6c0b-68ff-41dd-aa38-48cbafba8451/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 02:45:29.159234 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-042c5e66-6ff7-4dcd-a673-00e41a98fad1 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:29.159736 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-042c5e66-6ff7-4dcd-a673-00e41a98fad1 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 3cda6c0b-68ff-41dd-aa38-48cbafba8451] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:29.165757 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-042c5e66-6ff7-4dcd-a673-00e41a98fad1 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:29.166291 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-042c5e66-6ff7-4dcd-a673-00e41a98fad1 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:29.166729 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-042c5e66-6ff7-4dcd-a673-00e41a98fad1 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:29.167419 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-042c5e66-6ff7-4dcd-a673-00e41a98fad1 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:29.167870 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-042c5e66-6ff7-4dcd-a673-00e41a98fad1 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:29.168294 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-042c5e66-6ff7-4dcd-a673-00e41a98fad1 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:29.253394 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.objects.instance [None req-042c5e66-6ff7-4dcd-a673-00e41a98fad1 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lazy-loading 'services' on Instance uuid 3cda6c0b-68ff-41dd-aa38-48cbafba8451 {{(pid=124425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 02:45:29.327767 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-042c5e66-6ff7-4dcd-a673-00e41a98fad1 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3cda6c0b-68ff-41dd-aa38-48cbafba8451/os-volume_attachments/d35735a5-249b-4872-9423-18b9ca88a305" status: 202 len: 0 microversion: 2.1 time: 0.172445 Aug 09 02:45:29.328350 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 309/634] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Aug 9 02:45:29 2022] DELETE /compute/v2.1/servers/3cda6c0b-68ff-41dd-aa38-48cbafba8451/os-volume_attachments/d35735a5-249b-4872-9423-18b9ca88a305 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 02:45:29.336899 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-8184fa33-2683-4b41-a18a-9d9757f0e089 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:29.339099 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-8184fa33-2683-4b41-a18a-9d9757f0e089 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 3cda6c0b-68ff-41dd-aa38-48cbafba8451] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:29.346141 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8184fa33-2683-4b41-a18a-9d9757f0e089 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:29.346643 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8184fa33-2683-4b41-a18a-9d9757f0e089 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:29.347072 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8184fa33-2683-4b41-a18a-9d9757f0e089 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:29.347750 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8184fa33-2683-4b41-a18a-9d9757f0e089 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:29.348194 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8184fa33-2683-4b41-a18a-9d9757f0e089 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:29.348620 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8184fa33-2683-4b41-a18a-9d9757f0e089 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:29.362399 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:45:29.379406 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-8184fa33-2683-4b41-a18a-9d9757f0e089 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/3cda6c0b-68ff-41dd-aa38-48cbafba8451/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046610 Aug 09 02:45:29.379957 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 326/635] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 9 02:45:29 2022] GET /compute/v2.1/servers/3cda6c0b-68ff-41dd-aa38-48cbafba8451/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:45:29.727657 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-4eea5b6e-0249-4df7-a650-207887bb7b49 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:29.728678 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-4eea5b6e-0249-4df7-a650-207887bb7b49 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: ac4668e2-6e51-4087-bfca-a22cff3b147f] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:29.739614 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4eea5b6e-0249-4df7-a650-207887bb7b49 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:29.740479 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4eea5b6e-0249-4df7-a650-207887bb7b49 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:29.741189 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4eea5b6e-0249-4df7-a650-207887bb7b49 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:29.742724 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4eea5b6e-0249-4df7-a650-207887bb7b49 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:29.743511 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4eea5b6e-0249-4df7-a650-207887bb7b49 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:29.744164 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4eea5b6e-0249-4df7-a650-207887bb7b49 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:29.879059 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-4eea5b6e-0249-4df7-a650-207887bb7b49 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:29.886848 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-4eea5b6e-0249-4df7-a650-207887bb7b49 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f" status: 200 len: 1362 microversion: 2.1 time: 0.167199 Aug 09 02:45:29.887421 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 310/636] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:45:29 2022] GET /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:45:30.392141 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-6e5e90bb-ed0c-4a09-b17d-41c5c1491302 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:30.394427 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-6e5e90bb-ed0c-4a09-b17d-41c5c1491302 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 3cda6c0b-68ff-41dd-aa38-48cbafba8451] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:30.401145 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6e5e90bb-ed0c-4a09-b17d-41c5c1491302 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:30.401624 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6e5e90bb-ed0c-4a09-b17d-41c5c1491302 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:30.402080 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6e5e90bb-ed0c-4a09-b17d-41c5c1491302 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:30.402796 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6e5e90bb-ed0c-4a09-b17d-41c5c1491302 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:30.403241 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6e5e90bb-ed0c-4a09-b17d-41c5c1491302 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:30.403657 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6e5e90bb-ed0c-4a09-b17d-41c5c1491302 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:30.432649 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-6e5e90bb-ed0c-4a09-b17d-41c5c1491302 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/3cda6c0b-68ff-41dd-aa38-48cbafba8451/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044500 Aug 09 02:45:30.433176 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 327/637] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 9 02:45:30 2022] GET /compute/v2.1/servers/3cda6c0b-68ff-41dd-aa38-48cbafba8451/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:45:30.908273 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-9e4bd0b4-2f89-46d4-bf8c-c9cdfa31861e tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:30.908809 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-9e4bd0b4-2f89-46d4-bf8c-c9cdfa31861e tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: ac4668e2-6e51-4087-bfca-a22cff3b147f] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:30.915152 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9e4bd0b4-2f89-46d4-bf8c-c9cdfa31861e tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:30.915637 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9e4bd0b4-2f89-46d4-bf8c-c9cdfa31861e tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:30.916056 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9e4bd0b4-2f89-46d4-bf8c-c9cdfa31861e tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:30.917355 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9e4bd0b4-2f89-46d4-bf8c-c9cdfa31861e tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:30.917821 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9e4bd0b4-2f89-46d4-bf8c-c9cdfa31861e tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:30.918266 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9e4bd0b4-2f89-46d4-bf8c-c9cdfa31861e tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:31.050391 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-9e4bd0b4-2f89-46d4-bf8c-c9cdfa31861e tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:31.058103 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-9e4bd0b4-2f89-46d4-bf8c-c9cdfa31861e tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f" status: 200 len: 1362 microversion: 2.1 time: 0.153902 Aug 09 02:45:31.058697 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 311/638] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:45:30 2022] GET /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:45:31.445391 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-b415ebf3-6f7b-493e-a916-e8a37a8f4185 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:31.447601 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-b415ebf3-6f7b-493e-a916-e8a37a8f4185 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 3cda6c0b-68ff-41dd-aa38-48cbafba8451] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:31.454524 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b415ebf3-6f7b-493e-a916-e8a37a8f4185 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:31.454997 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b415ebf3-6f7b-493e-a916-e8a37a8f4185 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:31.455420 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b415ebf3-6f7b-493e-a916-e8a37a8f4185 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:31.456096 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b415ebf3-6f7b-493e-a916-e8a37a8f4185 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:31.456534 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b415ebf3-6f7b-493e-a916-e8a37a8f4185 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:31.456941 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b415ebf3-6f7b-493e-a916-e8a37a8f4185 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:31.485445 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-b415ebf3-6f7b-493e-a916-e8a37a8f4185 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/3cda6c0b-68ff-41dd-aa38-48cbafba8451/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043688 Aug 09 02:45:31.486011 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 328/639] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 9 02:45:31 2022] GET /compute/v2.1/servers/3cda6c0b-68ff-41dd-aa38-48cbafba8451/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 02:45:31.560233 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-d184850f-00de-43f0-a913-4e17df9d62ef tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:31.560936 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-d184850f-00de-43f0-a913-4e17df9d62ef tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 3cda6c0b-68ff-41dd-aa38-48cbafba8451] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:31.570036 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d184850f-00de-43f0-a913-4e17df9d62ef tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:31.570776 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d184850f-00de-43f0-a913-4e17df9d62ef tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:31.571327 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d184850f-00de-43f0-a913-4e17df9d62ef tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:31.572210 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d184850f-00de-43f0-a913-4e17df9d62ef tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:31.572834 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d184850f-00de-43f0-a913-4e17df9d62ef tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:31.573432 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d184850f-00de-43f0-a913-4e17df9d62ef tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:31.600199 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-d184850f-00de-43f0-a913-4e17df9d62ef tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 3cda6c0b-68ff-41dd-aa38-48cbafba8451] Going to try to terminate instance {{(pid=124425) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 02:45:31.633265 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:45:31.680143 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-d184850f-00de-43f0-a913-4e17df9d62ef tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3cda6c0b-68ff-41dd-aa38-48cbafba8451" status: 204 len: 0 microversion: 2.1 time: 0.125909 Aug 09 02:45:31.680761 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 312/640] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 9 02:45:31 2022] DELETE /compute/v2.1/servers/3cda6c0b-68ff-41dd-aa38-48cbafba8451 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 02:45:31.689132 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-c0b2832a-58ae-4b3b-8b92-7bee60b2d9f1 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:31.689743 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-c0b2832a-58ae-4b3b-8b92-7bee60b2d9f1 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 3cda6c0b-68ff-41dd-aa38-48cbafba8451] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:31.695723 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-c0b2832a-58ae-4b3b-8b92-7bee60b2d9f1 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:31.696198 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-c0b2832a-58ae-4b3b-8b92-7bee60b2d9f1 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:31.696622 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-c0b2832a-58ae-4b3b-8b92-7bee60b2d9f1 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:31.697292 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-c0b2832a-58ae-4b3b-8b92-7bee60b2d9f1 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:31.697735 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-c0b2832a-58ae-4b3b-8b92-7bee60b2d9f1 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:31.698185 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-c0b2832a-58ae-4b3b-8b92-7bee60b2d9f1 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:31.843300 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-c0b2832a-58ae-4b3b-8b92-7bee60b2d9f1 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:31.851371 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-c0b2832a-58ae-4b3b-8b92-7bee60b2d9f1 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/3cda6c0b-68ff-41dd-aa38-48cbafba8451" status: 200 len: 1680 microversion: 2.1 time: 0.166067 Aug 09 02:45:31.851934 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 329/641] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:45:31 2022] GET /compute/v2.1/servers/3cda6c0b-68ff-41dd-aa38-48cbafba8451 => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:45:32.083014 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-334a6b0f-5c6d-4799-bdb2-1057325c06b0 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:32.084123 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-334a6b0f-5c6d-4799-bdb2-1057325c06b0 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: ac4668e2-6e51-4087-bfca-a22cff3b147f] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:32.094999 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-334a6b0f-5c6d-4799-bdb2-1057325c06b0 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:32.095423 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-334a6b0f-5c6d-4799-bdb2-1057325c06b0 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:32.095857 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-334a6b0f-5c6d-4799-bdb2-1057325c06b0 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:32.096546 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-334a6b0f-5c6d-4799-bdb2-1057325c06b0 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:32.097023 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-334a6b0f-5c6d-4799-bdb2-1057325c06b0 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:32.097447 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-334a6b0f-5c6d-4799-bdb2-1057325c06b0 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:32.232208 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-334a6b0f-5c6d-4799-bdb2-1057325c06b0 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:32.240749 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-334a6b0f-5c6d-4799-bdb2-1057325c06b0 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f" status: 200 len: 1362 microversion: 2.1 time: 0.164970 Aug 09 02:45:32.241319 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 313/642] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:45:32 2022] GET /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:45:32.873504 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-77a2876a-986a-490d-92e5-de466cc2565b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:32.874070 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-77a2876a-986a-490d-92e5-de466cc2565b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 3cda6c0b-68ff-41dd-aa38-48cbafba8451] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:32.881030 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-77a2876a-986a-490d-92e5-de466cc2565b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:32.881511 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-77a2876a-986a-490d-92e5-de466cc2565b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:32.881938 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-77a2876a-986a-490d-92e5-de466cc2565b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:32.882656 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-77a2876a-986a-490d-92e5-de466cc2565b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:32.883113 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-77a2876a-986a-490d-92e5-de466cc2565b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:32.883533 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-77a2876a-986a-490d-92e5-de466cc2565b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:33.018099 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-77a2876a-986a-490d-92e5-de466cc2565b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:33.026258 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-77a2876a-986a-490d-92e5-de466cc2565b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/3cda6c0b-68ff-41dd-aa38-48cbafba8451" status: 200 len: 1680 microversion: 2.1 time: 0.156595 Aug 09 02:45:33.026766 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 330/643] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:45:32 2022] GET /compute/v2.1/servers/3cda6c0b-68ff-41dd-aa38-48cbafba8451 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:45:33.265401 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-f487e5de-7b0e-4bb1-9bdd-37698967ee5f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:33.266469 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-f487e5de-7b0e-4bb1-9bdd-37698967ee5f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: ac4668e2-6e51-4087-bfca-a22cff3b147f] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:33.269002 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:45:33.275145 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f487e5de-7b0e-4bb1-9bdd-37698967ee5f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:33.275719 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f487e5de-7b0e-4bb1-9bdd-37698967ee5f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:33.276158 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f487e5de-7b0e-4bb1-9bdd-37698967ee5f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:33.276853 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f487e5de-7b0e-4bb1-9bdd-37698967ee5f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:33.277314 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f487e5de-7b0e-4bb1-9bdd-37698967ee5f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:33.277734 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f487e5de-7b0e-4bb1-9bdd-37698967ee5f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:33.407533 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-f487e5de-7b0e-4bb1-9bdd-37698967ee5f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:33.415469 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-f487e5de-7b0e-4bb1-9bdd-37698967ee5f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f" status: 200 len: 1362 microversion: 2.1 time: 0.156720 Aug 09 02:45:33.415953 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 314/644] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:45:33 2022] GET /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:45:34.048013 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-5caade1c-2eea-40e1-b43a-672bb7bfe0f5 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:34.048636 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-5caade1c-2eea-40e1-b43a-672bb7bfe0f5 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 3cda6c0b-68ff-41dd-aa38-48cbafba8451] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:34.055250 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5caade1c-2eea-40e1-b43a-672bb7bfe0f5 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:34.055706 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5caade1c-2eea-40e1-b43a-672bb7bfe0f5 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:34.056129 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5caade1c-2eea-40e1-b43a-672bb7bfe0f5 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:34.056824 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5caade1c-2eea-40e1-b43a-672bb7bfe0f5 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:34.057268 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5caade1c-2eea-40e1-b43a-672bb7bfe0f5 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:34.057681 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5caade1c-2eea-40e1-b43a-672bb7bfe0f5 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:34.277070 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-5caade1c-2eea-40e1-b43a-672bb7bfe0f5 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:34.284934 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-5caade1c-2eea-40e1-b43a-672bb7bfe0f5 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/3cda6c0b-68ff-41dd-aa38-48cbafba8451" status: 200 len: 1680 microversion: 2.1 time: 0.240948 Aug 09 02:45:34.285524 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 331/645] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:45:34 2022] GET /compute/v2.1/servers/3cda6c0b-68ff-41dd-aa38-48cbafba8451 => generated 1680 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:45:34.435872 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-8b5eb830-80b1-4701-a578-a1339dd2ed71 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:34.436489 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-8b5eb830-80b1-4701-a578-a1339dd2ed71 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: ac4668e2-6e51-4087-bfca-a22cff3b147f] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:34.443937 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8b5eb830-80b1-4701-a578-a1339dd2ed71 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:34.444410 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8b5eb830-80b1-4701-a578-a1339dd2ed71 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:34.444876 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8b5eb830-80b1-4701-a578-a1339dd2ed71 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:34.445546 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8b5eb830-80b1-4701-a578-a1339dd2ed71 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:34.445986 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8b5eb830-80b1-4701-a578-a1339dd2ed71 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:34.446455 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8b5eb830-80b1-4701-a578-a1339dd2ed71 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:34.628491 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-8b5eb830-80b1-4701-a578-a1339dd2ed71 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:34.636377 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-8b5eb830-80b1-4701-a578-a1339dd2ed71 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f" status: 200 len: 1362 microversion: 2.1 time: 0.204379 Aug 09 02:45:34.637390 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 315/646] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:45:34 2022] GET /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f => generated 1362 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:45:34.740070 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [req-b51b5b6c-dd04-4e56-830e-020668b8c013 req-fde20e8f-a901-42de-a7d0-bcba9502c5e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cda6c0b-68ff-41dd-aa38-48cbafba8451", "name": "network-vif-deleted", "tag": "dd6d3011-7693-4d78-b859-3220bb048c68"}]} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:45:34.746733 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_cell0:SELECT=2 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:45:34.747823 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_cell0:SELECT=6 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:45:34.752621 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-b51b5b6c-dd04-4e56-830e-020668b8c013 req-fde20e8f-a901-42de-a7d0-bcba9502c5e7 service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:34.753498 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-b51b5b6c-dd04-4e56-830e-020668b8c013 req-fde20e8f-a901-42de-a7d0-bcba9502c5e7 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:34.754224 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-b51b5b6c-dd04-4e56-830e-020668b8c013 req-fde20e8f-a901-42de-a7d0-bcba9502c5e7 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:34.766320 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.compute.server_external_events [req-b51b5b6c-dd04-4e56-830e-020668b8c013 req-fde20e8f-a901-42de-a7d0-bcba9502c5e7 service nova] Creating event network-vif-deleted:dd6d3011-7693-4d78-b859-3220bb048c68 for instance 3cda6c0b-68ff-41dd-aa38-48cbafba8451 on hv-cinder-85246 Aug 09 02:45:34.776021 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [req-b51b5b6c-dd04-4e56-830e-020668b8c013 req-fde20e8f-a901-42de-a7d0-bcba9502c5e7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041539 Aug 09 02:45:34.777116 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 332/647] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:45:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:45:35.306550 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-16f1c0f2-b1b1-471f-82d4-66fb69f64fbe tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:35.307165 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-16f1c0f2-b1b1-471f-82d4-66fb69f64fbe tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 3cda6c0b-68ff-41dd-aa38-48cbafba8451] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:35.309009 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_cell0:SELECT=6 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:45:35.314772 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-16f1c0f2-b1b1-471f-82d4-66fb69f64fbe tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:35.315257 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-16f1c0f2-b1b1-471f-82d4-66fb69f64fbe tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:35.315688 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-16f1c0f2-b1b1-471f-82d4-66fb69f64fbe tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:35.316444 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-16f1c0f2-b1b1-471f-82d4-66fb69f64fbe tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:35.317016 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-16f1c0f2-b1b1-471f-82d4-66fb69f64fbe tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:35.317520 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-16f1c0f2-b1b1-471f-82d4-66fb69f64fbe tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:35.351907 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-16f1c0f2-b1b1-471f-82d4-66fb69f64fbe tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:35.352400 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-16f1c0f2-b1b1-471f-82d4-66fb69f64fbe tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:35.352825 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-16f1c0f2-b1b1-471f-82d4-66fb69f64fbe tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:35.353274 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.objects.instance [None req-16f1c0f2-b1b1-471f-82d4-66fb69f64fbe tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lazy-loading 'fault' on Instance uuid 3cda6c0b-68ff-41dd-aa38-48cbafba8451 {{(pid=124425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 02:45:35.406088 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-16f1c0f2-b1b1-471f-82d4-66fb69f64fbe tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:35.419238 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-16f1c0f2-b1b1-471f-82d4-66fb69f64fbe tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/3cda6c0b-68ff-41dd-aa38-48cbafba8451" status: 200 len: 1330 microversion: 2.1 time: 0.117188 Aug 09 02:45:35.420652 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 316/648] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:45:35 2022] GET /compute/v2.1/servers/3cda6c0b-68ff-41dd-aa38-48cbafba8451 => generated 1330 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:45:35.658995 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-65f27d6f-3db0-4a08-a8d6-b38950902270 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:35.659744 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-65f27d6f-3db0-4a08-a8d6-b38950902270 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: ac4668e2-6e51-4087-bfca-a22cff3b147f] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:35.666847 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-65f27d6f-3db0-4a08-a8d6-b38950902270 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:35.667335 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-65f27d6f-3db0-4a08-a8d6-b38950902270 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:35.667978 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-65f27d6f-3db0-4a08-a8d6-b38950902270 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:35.669050 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-65f27d6f-3db0-4a08-a8d6-b38950902270 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:35.669488 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-65f27d6f-3db0-4a08-a8d6-b38950902270 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:35.672928 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-65f27d6f-3db0-4a08-a8d6-b38950902270 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:35.817104 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-65f27d6f-3db0-4a08-a8d6-b38950902270 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:35.825006 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-65f27d6f-3db0-4a08-a8d6-b38950902270 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f" status: 200 len: 1362 microversion: 2.1 time: 0.171139 Aug 09 02:45:35.825546 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 333/649] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:45:35 2022] GET /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:45:35.879440 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [req-23a46b02-3853-426e-9ef9-d2b721b554b1 req-2d9593d7-e175-4756-ad14-3e31ef031c21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac4668e2-6e51-4087-bfca-a22cff3b147f", "name": "network-vif-plugged", "status": "completed", "tag": "134cb462-1c0a-49ec-94c5-16a7d99add24"}]} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:45:35.890780 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-23a46b02-3853-426e-9ef9-d2b721b554b1 req-2d9593d7-e175-4756-ad14-3e31ef031c21 service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:35.891222 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-23a46b02-3853-426e-9ef9-d2b721b554b1 req-2d9593d7-e175-4756-ad14-3e31ef031c21 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:35.891738 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-23a46b02-3853-426e-9ef9-d2b721b554b1 req-2d9593d7-e175-4756-ad14-3e31ef031c21 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:35.902508 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.compute.server_external_events [req-23a46b02-3853-426e-9ef9-d2b721b554b1 req-2d9593d7-e175-4756-ad14-3e31ef031c21 service nova] Creating event network-vif-plugged:134cb462-1c0a-49ec-94c5-16a7d99add24 for instance ac4668e2-6e51-4087-bfca-a22cff3b147f on hv-cinder-85246 Aug 09 02:45:35.907460 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [req-23a46b02-3853-426e-9ef9-d2b721b554b1 req-2d9593d7-e175-4756-ad14-3e31ef031c21 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031868 Aug 09 02:45:35.908038 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 317/650] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:45:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 02:45:36.546544 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-726fc221-3175-4993-8bd1-22a326091087 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:36.547169 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-726fc221-3175-4993-8bd1-22a326091087 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 3cda6c0b-68ff-41dd-aa38-48cbafba8451] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:36.553111 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-726fc221-3175-4993-8bd1-22a326091087 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:36.553590 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-726fc221-3175-4993-8bd1-22a326091087 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:36.554011 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-726fc221-3175-4993-8bd1-22a326091087 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:36.554723 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-726fc221-3175-4993-8bd1-22a326091087 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:36.555170 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-726fc221-3175-4993-8bd1-22a326091087 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:36.555585 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-726fc221-3175-4993-8bd1-22a326091087 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:36.568786 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.wsgi [None req-726fc221-3175-4993-8bd1-22a326091087 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] HTTP exception thrown: Instance 3cda6c0b-68ff-41dd-aa38-48cbafba8451 could not be found. Aug 09 02:45:36.570541 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-726fc221-3175-4993-8bd1-22a326091087 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Request method failure captured: Aug 09 02:45:36.570541 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: request: GET /compute/v2.1/servers/3cda6c0b-68ff-41dd-aa38-48cbafba8451 HTTP/1.1 Aug 09 02:45:36.570541 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Accept: application/json Aug 09 02:45:36.570541 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Accept-Encoding: identity Aug 09 02:45:36.570541 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Connection: close Aug 09 02:45:36.570541 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Content-Length: 0 Aug 09 02:45:36.570541 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Content-Type: application/json Aug 09 02:45:36.570541 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Host: 10.222.0.20 Aug 09 02:45:36.570541 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Openstack-System-Scope: None Aug 09 02:45:36.570541 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: User-Agent: python-urllib3/1.26.11 Aug 09 02:45:36.570541 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Auth-Token: gAAAAABi8ckjyQvMSPVjOXRhh70Rnc1ANMFv7G7JLArfSACfDLzvvcneDlsL-sI9hF681zwEIODxGFE7k1OsPJO-SGVxluvBNMmaFLG_fx-H9D1ZvGPLVeuDO_toy5qwJovkKz9pwj7m5cniNs8yMlVJKkLfQNx_gl4pQZFRtesItHh6k1DiYvw Aug 09 02:45:36.570541 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Domain-Id: None Aug 09 02:45:36.570541 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Domain-Name: None Aug 09 02:45:36.570541 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Identity-Status: Confirmed Aug 09 02:45:36.570541 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Is-Admin-Project: True Aug 09 02:45:36.570541 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Domain-Id: default Aug 09 02:45:36.570541 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Domain-Name: Default Aug 09 02:45:36.570541 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Id: 8ce26c854fc24cadb2be5ebd441b8f3a Aug 09 02:45:36.570541 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Name: tempest-AttachVolumeNegativeTest-1568455203 Aug 09 02:45:36.570541 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Role: reader,member Aug 09 02:45:36.570541 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Roles: reader,member Aug 09 02:45:36.572062 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8ce26c854fc24cadb2be5ebd441b8f3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8ce26c854fc24cadb2be5ebd441b8f3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8ce26c854fc24cadb2be5ebd441b8f3a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8ce26c854fc24cadb2be5ebd441b8f3a"}]}] Aug 09 02:45:36.572062 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant: tempest-AttachVolumeNegativeTest-1568455203 Aug 09 02:45:36.572062 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant-Id: 8ce26c854fc24cadb2be5ebd441b8f3a Aug 09 02:45:36.572062 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1568455203 Aug 09 02:45:36.572062 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User: tempest-AttachVolumeNegativeTest-1568455203-project Aug 09 02:45:36.572062 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Domain-Id: default Aug 09 02:45:36.572062 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Domain-Name: Default Aug 09 02:45:36.572062 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Id: 43232b9b191047f9a3e6ebab7ad36f02 Aug 09 02:45:36.572062 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Name: tempest-AttachVolumeNegativeTest-1568455203-project Aug 09 02:45:36.572062 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: method: > Aug 09 02:45:36.572062 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: exception: Instance 3cda6c0b-68ff-41dd-aa38-48cbafba8451 could not be found. Aug 09 02:45:36.572062 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: action_args: {'id': '3cda6c0b-68ff-41dd-aa38-48cbafba8451'} Aug 09 02:45:36.572970 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 02:45:36.572970 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:45:36.572970 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 02:45:36.572970 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 02:45:36.572970 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 02:45:36.572970 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 02:45:36.572970 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 02:45:36.572970 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 02:45:36.572970 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 02:45:36.572970 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 02:45:36.572970 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cda6c0b-68ff-41dd-aa38-48cbafba8451 could not be found. Aug 09 02:45:36.572970 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:45:36.572970 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:45:36.572970 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:45:36.572970 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:45:36.572970 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:45:36.572970 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:45:36.572970 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 02:45:36.572970 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 02:45:36.572970 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 02:45:36.574526 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 02:45:36.574526 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 02:45:36.574526 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 02:45:36.574526 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 02:45:36.574526 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 02:45:36.574526 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 02:45:36.574526 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 02:45:36.574526 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cda6c0b-68ff-41dd-aa38-48cbafba8451 could not be found. Aug 09 02:45:36.574526 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:45:36.574526 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:45:36.574526 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:45:36.574526 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:45:36.574526 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:45:36.574526 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:45:36.574526 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 02:45:36.574526 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 02:45:36.574526 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cda6c0b-68ff-41dd-aa38-48cbafba8451 could not be found. Aug 09 02:45:36.574526 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:45:36.575939 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-726fc221-3175-4993-8bd1-22a326091087 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Returning 404 to user: Instance 3cda6c0b-68ff-41dd-aa38-48cbafba8451 could not be found. {{(pid=124427) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 02:45:36.575939 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-726fc221-3175-4993-8bd1-22a326091087 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/3cda6c0b-68ff-41dd-aa38-48cbafba8451" status: 404 len: 111 microversion: 2.1 time: 0.134567 Aug 09 02:45:36.575939 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 334/651] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:45:36 2022] GET /compute/v2.1/servers/3cda6c0b-68ff-41dd-aa38-48cbafba8451 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 02:45:36.581604 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-95ece320-4f97-459f-a205-6be577016f9c tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '.version_select at 0x7fb0a0353e50>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:36.602547 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-95ece320-4f97-459f-a205-6be577016f9c tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-135680751" status: 202 len: 0 microversion: 2.1 time: 0.025034 Aug 09 02:45:36.603119 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 318/652] 10.222.0.20 () {58 vars in 1218 bytes} [Tue Aug 9 02:45:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-135680751 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 02:45:36.846531 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-6f418702-873b-430a-9e48-a612ae63eef8 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:36.847138 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-6f418702-873b-430a-9e48-a612ae63eef8 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: ac4668e2-6e51-4087-bfca-a22cff3b147f] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:36.854179 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6f418702-873b-430a-9e48-a612ae63eef8 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:36.854727 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6f418702-873b-430a-9e48-a612ae63eef8 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:36.855164 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6f418702-873b-430a-9e48-a612ae63eef8 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:36.855858 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6f418702-873b-430a-9e48-a612ae63eef8 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:36.856326 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6f418702-873b-430a-9e48-a612ae63eef8 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:36.856745 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6f418702-873b-430a-9e48-a612ae63eef8 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:36.993029 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-6f418702-873b-430a-9e48-a612ae63eef8 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:37.000967 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-6f418702-873b-430a-9e48-a612ae63eef8 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f" status: 200 len: 1362 microversion: 2.1 time: 0.158370 Aug 09 02:45:37.001553 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 335/653] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:45:36 2022] GET /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:45:37.647622 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-29923437-6138-4785-afa5-2f814420a199 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Action: 'create', calling method: .version_select at 0x7fb0a02bc430>, body: {"keypair": {"name": "tempest-keypair-1007592254", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJrXaElR7EFySYEz6xl7GCIXih0bo3uJzEgDiM4filoX5WHAWDtXk2DNWcBrKJs6vOt13BpoPMR8IebDS3CInuk/jHOKIEHd4DXyPbVJrzO4z7ismc/zDLN3RTLwnIxAg=="}} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:45:37.664503 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.quota [None req-29923437-6138-4785-afa5-2f814420a199 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Getting quotas for project 8ce26c854fc24cadb2be5ebd441b8f3a. Resources: {'key_pairs'} {{(pid=124425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 02:45:37.668895 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.quota [None req-29923437-6138-4785-afa5-2f814420a199 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Getting quotas for user 43232b9b191047f9a3e6ebab7ad36f02 and project 8ce26c854fc24cadb2be5ebd441b8f3a. Resources: {'key_pairs'} {{(pid=124425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 02:45:37.693466 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-29923437-6138-4785-afa5-2f814420a199 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050296 Aug 09 02:45:37.694093 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 319/654] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Aug 9 02:45:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:45:37.825801 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-c8b51c9a-5db1-402d-afa2-ee002430e046 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:37.826318 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-c8b51c9a-5db1-402d-afa2-ee002430e046 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: b9369cf3-95d7-41d2-8157-ca2c165b062d] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:37.832340 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-c8b51c9a-5db1-402d-afa2-ee002430e046 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:37.832811 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-c8b51c9a-5db1-402d-afa2-ee002430e046 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:37.833233 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-c8b51c9a-5db1-402d-afa2-ee002430e046 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:37.833914 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-c8b51c9a-5db1-402d-afa2-ee002430e046 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:37.834404 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-c8b51c9a-5db1-402d-afa2-ee002430e046 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:37.834818 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-c8b51c9a-5db1-402d-afa2-ee002430e046 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:37.928751 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.objects.instance [None req-c8b51c9a-5db1-402d-afa2-ee002430e046 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lazy-loading 'services' on Instance uuid b9369cf3-95d7-41d2-8157-ca2c165b062d {{(pid=124427) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 02:45:38.001603 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-c8b51c9a-5db1-402d-afa2-ee002430e046 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d/os-volume_attachments/553e3daa-06f7-485f-8835-4e102fd8880c" status: 202 len: 0 microversion: 2.1 time: 0.179542 Aug 09 02:45:38.002430 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 336/655] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Aug 9 02:45:37 2022] DELETE /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d/os-volume_attachments/553e3daa-06f7-485f-8835-4e102fd8880c => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 02:45:38.011000 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-14f9b9b5-1d7b-4bfd-b673-4e9ee3ad7bc8 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:38.013606 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-14f9b9b5-1d7b-4bfd-b673-4e9ee3ad7bc8 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: b9369cf3-95d7-41d2-8157-ca2c165b062d] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:38.022530 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-fcf2b6f6-29a6-4f4e-befc-a9c441061f35 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:38.023218 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-fcf2b6f6-29a6-4f4e-befc-a9c441061f35 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: ac4668e2-6e51-4087-bfca-a22cff3b147f] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:38.029498 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-14f9b9b5-1d7b-4bfd-b673-4e9ee3ad7bc8 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:38.029992 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-14f9b9b5-1d7b-4bfd-b673-4e9ee3ad7bc8 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:38.030458 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-14f9b9b5-1d7b-4bfd-b673-4e9ee3ad7bc8 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:38.031155 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-14f9b9b5-1d7b-4bfd-b673-4e9ee3ad7bc8 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:38.031778 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-14f9b9b5-1d7b-4bfd-b673-4e9ee3ad7bc8 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:38.032271 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-14f9b9b5-1d7b-4bfd-b673-4e9ee3ad7bc8 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:38.032637 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-fcf2b6f6-29a6-4f4e-befc-a9c441061f35 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:38.033175 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-fcf2b6f6-29a6-4f4e-befc-a9c441061f35 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:38.033605 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-fcf2b6f6-29a6-4f4e-befc-a9c441061f35 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:38.034889 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-fcf2b6f6-29a6-4f4e-befc-a9c441061f35 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:38.034889 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-fcf2b6f6-29a6-4f4e-befc-a9c441061f35 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:38.035308 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-fcf2b6f6-29a6-4f4e-befc-a9c441061f35 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:38.081776 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-14f9b9b5-1d7b-4bfd-b673-4e9ee3ad7bc8 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074784 Aug 09 02:45:38.082488 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 320/656] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 9 02:45:38 2022] GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:45:38.208837 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-fcf2b6f6-29a6-4f4e-befc-a9c441061f35 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:38.216293 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-fcf2b6f6-29a6-4f4e-befc-a9c441061f35 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f" status: 200 len: 1362 microversion: 2.1 time: 0.197884 Aug 09 02:45:38.216865 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 337/657] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:45:38 2022] GET /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f => generated 1362 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:45:39.090742 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-85fd01c5-ae5c-43d0-8bfc-41984bfaa076 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-895469976", "imageRef": "04a06944-b2a8-4a65-b2a6-7ed3ff18a627", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6bf516e7-9ea4-4f2e-9b3b-a70a745206d7"}], "security_groups": [{"name": "tempest-securitygroup--998250110"}], "key_name": "tempest-keypair-1007592254", "user_data": "}} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:45:39.094442 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-291e2038-ce27-4a38-83ed-51012e32264f tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:39.096730 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-291e2038-ce27-4a38-83ed-51012e32264f tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: b9369cf3-95d7-41d2-8157-ca2c165b062d] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:39.102993 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-291e2038-ce27-4a38-83ed-51012e32264f tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:39.103473 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-291e2038-ce27-4a38-83ed-51012e32264f tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:39.103898 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-291e2038-ce27-4a38-83ed-51012e32264f tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:39.105141 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-291e2038-ce27-4a38-83ed-51012e32264f tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:39.105444 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-291e2038-ce27-4a38-83ed-51012e32264f tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:39.105863 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-291e2038-ce27-4a38-83ed-51012e32264f tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:39.136774 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-291e2038-ce27-4a38-83ed-51012e32264f tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046353 Aug 09 02:45:39.137335 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 338/658] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 9 02:45:39 2022] GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:45:39.196294 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.network.neutron [None req-85fd01c5-ae5c-43d0-8bfc-41984bfaa076 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] validate_networks() for [('6bf516e7-9ea4-4f2e-9b3b-a70a745206d7', None, None, None, None, None)] {{(pid=124425) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 02:45:39.237314 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-42186142-4343-4b20-b658-33082c90715f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:39.238000 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-42186142-4343-4b20-b658-33082c90715f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: ac4668e2-6e51-4087-bfca-a22cff3b147f] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:39.244268 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-42186142-4343-4b20-b658-33082c90715f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:39.244749 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-42186142-4343-4b20-b658-33082c90715f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:39.245175 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-42186142-4343-4b20-b658-33082c90715f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:39.245848 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-42186142-4343-4b20-b658-33082c90715f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:39.246325 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-42186142-4343-4b20-b658-33082c90715f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:39.246768 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-42186142-4343-4b20-b658-33082c90715f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:39.441196 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-42186142-4343-4b20-b658-33082c90715f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:39.448804 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-42186142-4343-4b20-b658-33082c90715f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f" status: 200 len: 1547 microversion: 2.1 time: 0.215743 Aug 09 02:45:39.449766 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 339/659] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:45:39 2022] GET /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f => generated 1547 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:45:39.468626 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-1cacd3d3-6a96-46e5-a998-806ea928919e tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:39.469148 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-1cacd3d3-6a96-46e5-a998-806ea928919e tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: ac4668e2-6e51-4087-bfca-a22cff3b147f] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:39.475104 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1cacd3d3-6a96-46e5-a998-806ea928919e tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:39.475581 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1cacd3d3-6a96-46e5-a998-806ea928919e tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:39.476001 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1cacd3d3-6a96-46e5-a998-806ea928919e tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:39.476682 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1cacd3d3-6a96-46e5-a998-806ea928919e tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:39.477124 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1cacd3d3-6a96-46e5-a998-806ea928919e tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:39.477558 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1cacd3d3-6a96-46e5-a998-806ea928919e tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:39.596015 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-1cacd3d3-6a96-46e5-a998-806ea928919e tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.131090 Aug 09 02:45:39.596904 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 340/660] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Aug 9 02:45:39 2022] GET /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f/os-interface => generated 284 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 02:45:39.890277 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.virt.hardware [None req-85fd01c5-ae5c-43d0-8bfc-41984bfaa076 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Flavor limits 0:0:0 {{(pid=124425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 02:45:39.892104 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.virt.hardware [None req-85fd01c5-ae5c-43d0-8bfc-41984bfaa076 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Image limits 0:0:0 {{(pid=124425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 02:45:39.892852 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.virt.hardware [None req-85fd01c5-ae5c-43d0-8bfc-41984bfaa076 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Flavor pref 0:0:0 {{(pid=124425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 02:45:39.894137 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.virt.hardware [None req-85fd01c5-ae5c-43d0-8bfc-41984bfaa076 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Image pref 0:0:0 {{(pid=124425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 02:45:39.894571 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.virt.hardware [None req-85fd01c5-ae5c-43d0-8bfc-41984bfaa076 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 02:45:39.907260 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-85fd01c5-ae5c-43d0-8bfc-41984bfaa076 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:39.907732 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-85fd01c5-ae5c-43d0-8bfc-41984bfaa076 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:39.908238 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-85fd01c5-ae5c-43d0-8bfc-41984bfaa076 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:39.908951 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-85fd01c5-ae5c-43d0-8bfc-41984bfaa076 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:39.909390 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-85fd01c5-ae5c-43d0-8bfc-41984bfaa076 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:39.909804 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-85fd01c5-ae5c-43d0-8bfc-41984bfaa076 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:39.926163 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.quota [None req-85fd01c5-ae5c-43d0-8bfc-41984bfaa076 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Getting quotas for project 8ce26c854fc24cadb2be5ebd441b8f3a. Resources: {'cores', 'ram', 'instances'} {{(pid=124425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 02:45:39.930182 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.quota [None req-85fd01c5-ae5c-43d0-8bfc-41984bfaa076 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Getting quotas for user 43232b9b191047f9a3e6ebab7ad36f02 and project 8ce26c854fc24cadb2be5ebd441b8f3a. Resources: {'cores', 'ram', 'instances'} {{(pid=124425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 02:45:39.941456 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-85fd01c5-ae5c-43d0-8bfc-41984bfaa076 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Going to run 1 instances... {{(pid=124425) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 02:45:39.943859 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-85fd01c5-ae5c-43d0-8bfc-41984bfaa076 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 1cc38775-2c7d-4558-8ca9-3a2ef4917949] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='04a06944-b2a8-4a65-b2a6-7ed3ff18a627',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 02:45:39.991914 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-85fd01c5-ae5c-43d0-8bfc-41984bfaa076 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.906087 Aug 09 02:45:39.998370 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 321/661] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Aug 9 02:45:39 2022] POST /compute/v2.1/servers => generated 401 bytes in 908 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 02:45:40.003529 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-b573b04e-4257-439c-a345-e22938686195 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:40.004135 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-b573b04e-4257-439c-a345-e22938686195 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 1cc38775-2c7d-4558-8ca9-3a2ef4917949] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:40.064697 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-b573b04e-4257-439c-a345-e22938686195 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:40.071325 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-b573b04e-4257-439c-a345-e22938686195 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/1cc38775-2c7d-4558-8ca9-3a2ef4917949" status: 200 len: 1241 microversion: 2.1 time: 0.071630 Aug 09 02:45:40.071879 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 341/662] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:45:39 2022] GET /compute/v2.1/servers/1cc38775-2c7d-4558-8ca9-3a2ef4917949 => generated 1241 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:45:40.149421 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-a31175c1-3c5b-471a-b4f4-95e1fcd6d109 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:40.151692 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-a31175c1-3c5b-471a-b4f4-95e1fcd6d109 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: b9369cf3-95d7-41d2-8157-ca2c165b062d] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:40.158818 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a31175c1-3c5b-471a-b4f4-95e1fcd6d109 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:40.159323 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a31175c1-3c5b-471a-b4f4-95e1fcd6d109 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:40.159751 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a31175c1-3c5b-471a-b4f4-95e1fcd6d109 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:40.160439 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a31175c1-3c5b-471a-b4f4-95e1fcd6d109 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:40.160877 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a31175c1-3c5b-471a-b4f4-95e1fcd6d109 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:40.161295 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a31175c1-3c5b-471a-b4f4-95e1fcd6d109 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:40.190309 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-a31175c1-3c5b-471a-b4f4-95e1fcd6d109 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045289 Aug 09 02:45:40.191191 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 322/663] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 9 02:45:40 2022] GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 02:45:40.285435 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-7f53e3f2-184c-4c73-a709-18be41858dab tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:40.285925 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-7f53e3f2-184c-4c73-a709-18be41858dab tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: b9369cf3-95d7-41d2-8157-ca2c165b062d] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:40.294094 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7f53e3f2-184c-4c73-a709-18be41858dab tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:40.294854 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7f53e3f2-184c-4c73-a709-18be41858dab tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:40.295284 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7f53e3f2-184c-4c73-a709-18be41858dab tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:40.295968 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7f53e3f2-184c-4c73-a709-18be41858dab tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:40.296604 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7f53e3f2-184c-4c73-a709-18be41858dab tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:40.297033 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7f53e3f2-184c-4c73-a709-18be41858dab tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:40.323120 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-7f53e3f2-184c-4c73-a709-18be41858dab tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: b9369cf3-95d7-41d2-8157-ca2c165b062d] Going to try to terminate instance {{(pid=124427) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 02:45:40.423399 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-7f53e3f2-184c-4c73-a709-18be41858dab tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d" status: 204 len: 0 microversion: 2.1 time: 0.141305 Aug 09 02:45:40.424828 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 342/664] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 9 02:45:40 2022] DELETE /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 02:45:40.433995 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-75670cf1-6e10-4986-810b-a7648f8be1aa tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:40.434912 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-75670cf1-6e10-4986-810b-a7648f8be1aa tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: b9369cf3-95d7-41d2-8157-ca2c165b062d] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:40.441758 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-75670cf1-6e10-4986-810b-a7648f8be1aa tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:40.442285 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-75670cf1-6e10-4986-810b-a7648f8be1aa tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:40.442718 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-75670cf1-6e10-4986-810b-a7648f8be1aa tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:40.443419 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-75670cf1-6e10-4986-810b-a7648f8be1aa tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:40.443887 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-75670cf1-6e10-4986-810b-a7648f8be1aa tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:40.444325 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-75670cf1-6e10-4986-810b-a7648f8be1aa tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:40.630286 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-75670cf1-6e10-4986-810b-a7648f8be1aa tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:40.638114 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-75670cf1-6e10-4986-810b-a7648f8be1aa tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d" status: 200 len: 1688 microversion: 2.1 time: 0.208445 Aug 09 02:45:40.638696 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 323/665] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:45:40 2022] GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d => generated 1688 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:45:40.769081 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [req-ff513e2e-3426-4104-ad42-0d50c56747d5 req-09e537e0-d069-44bf-a534-d7bdfb007942 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac4668e2-6e51-4087-bfca-a22cff3b147f", "tag": "134cb462-1c0a-49ec-94c5-16a7d99add24"}]} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:45:40.778478 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-ff513e2e-3426-4104-ad42-0d50c56747d5 req-09e537e0-d069-44bf-a534-d7bdfb007942 service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:40.778957 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-ff513e2e-3426-4104-ad42-0d50c56747d5 req-09e537e0-d069-44bf-a534-d7bdfb007942 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:40.779383 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-ff513e2e-3426-4104-ad42-0d50c56747d5 req-09e537e0-d069-44bf-a534-d7bdfb007942 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:40.790718 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.compute.server_external_events [req-ff513e2e-3426-4104-ad42-0d50c56747d5 req-09e537e0-d069-44bf-a534-d7bdfb007942 service nova] Creating event network-changed:134cb462-1c0a-49ec-94c5-16a7d99add24 for instance ac4668e2-6e51-4087-bfca-a22cff3b147f on hv-cinder-85246 Aug 09 02:45:40.795527 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [req-ff513e2e-3426-4104-ad42-0d50c56747d5 req-09e537e0-d069-44bf-a534-d7bdfb007942 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030657 Aug 09 02:45:40.796123 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 343/666] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:45:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:45:41.092470 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-1d3d43d3-135c-4e25-8876-58dfae13b387 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:41.092980 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-1d3d43d3-135c-4e25-8876-58dfae13b387 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 1cc38775-2c7d-4558-8ca9-3a2ef4917949] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:41.099336 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1d3d43d3-135c-4e25-8876-58dfae13b387 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:41.099830 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1d3d43d3-135c-4e25-8876-58dfae13b387 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:41.100259 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1d3d43d3-135c-4e25-8876-58dfae13b387 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:41.100958 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1d3d43d3-135c-4e25-8876-58dfae13b387 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:41.101440 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1d3d43d3-135c-4e25-8876-58dfae13b387 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:41.101861 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1d3d43d3-135c-4e25-8876-58dfae13b387 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:41.168253 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-1d3d43d3-135c-4e25-8876-58dfae13b387 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:41.176974 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-1d3d43d3-135c-4e25-8876-58dfae13b387 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/1cc38775-2c7d-4558-8ca9-3a2ef4917949" status: 200 len: 1245 microversion: 2.1 time: 0.088473 Aug 09 02:45:41.187130 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 324/667] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:45:41 2022] GET /compute/v2.1/servers/1cc38775-2c7d-4558-8ca9-3a2ef4917949 => generated 1245 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:45:41.661019 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-e062c049-6a50-4da6-abdc-62faf05adf70 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:41.661716 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-e062c049-6a50-4da6-abdc-62faf05adf70 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: b9369cf3-95d7-41d2-8157-ca2c165b062d] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:41.668270 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e062c049-6a50-4da6-abdc-62faf05adf70 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:41.668678 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e062c049-6a50-4da6-abdc-62faf05adf70 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:41.669107 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e062c049-6a50-4da6-abdc-62faf05adf70 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:41.669792 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e062c049-6a50-4da6-abdc-62faf05adf70 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:41.670280 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e062c049-6a50-4da6-abdc-62faf05adf70 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:41.670688 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e062c049-6a50-4da6-abdc-62faf05adf70 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:41.673279 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:45:41.804254 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-e062c049-6a50-4da6-abdc-62faf05adf70 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:41.814047 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-e062c049-6a50-4da6-abdc-62faf05adf70 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d" status: 200 len: 1688 microversion: 2.1 time: 0.156101 Aug 09 02:45:41.814716 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 344/668] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:45:41 2022] GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d => generated 1688 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:45:42.201954 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-09c9a20d-bca1-4258-bb91-ddd46ed7c115 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:42.202585 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-09c9a20d-bca1-4258-bb91-ddd46ed7c115 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 1cc38775-2c7d-4558-8ca9-3a2ef4917949] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:42.210084 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-09c9a20d-bca1-4258-bb91-ddd46ed7c115 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:42.210609 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-09c9a20d-bca1-4258-bb91-ddd46ed7c115 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:42.211045 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-09c9a20d-bca1-4258-bb91-ddd46ed7c115 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:42.211738 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-09c9a20d-bca1-4258-bb91-ddd46ed7c115 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:42.212194 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-09c9a20d-bca1-4258-bb91-ddd46ed7c115 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:42.212619 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-09c9a20d-bca1-4258-bb91-ddd46ed7c115 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:42.281244 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-09c9a20d-bca1-4258-bb91-ddd46ed7c115 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:42.288916 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-09c9a20d-bca1-4258-bb91-ddd46ed7c115 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/1cc38775-2c7d-4558-8ca9-3a2ef4917949" status: 200 len: 1245 microversion: 2.1 time: 0.093330 Aug 09 02:45:42.289493 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 325/669] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:45:42 2022] GET /compute/v2.1/servers/1cc38775-2c7d-4558-8ca9-3a2ef4917949 => generated 1245 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:45:42.839160 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-601600d4-8010-4f80-afe3-8bd2b5b2b6d5 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:42.839774 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-601600d4-8010-4f80-afe3-8bd2b5b2b6d5 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: b9369cf3-95d7-41d2-8157-ca2c165b062d] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:42.849177 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-601600d4-8010-4f80-afe3-8bd2b5b2b6d5 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:42.849886 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-601600d4-8010-4f80-afe3-8bd2b5b2b6d5 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:42.850563 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-601600d4-8010-4f80-afe3-8bd2b5b2b6d5 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:42.851517 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-601600d4-8010-4f80-afe3-8bd2b5b2b6d5 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:42.852097 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-601600d4-8010-4f80-afe3-8bd2b5b2b6d5 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:42.852677 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-601600d4-8010-4f80-afe3-8bd2b5b2b6d5 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:42.987938 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-601600d4-8010-4f80-afe3-8bd2b5b2b6d5 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:42.996941 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-601600d4-8010-4f80-afe3-8bd2b5b2b6d5 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d" status: 200 len: 1688 microversion: 2.1 time: 0.164208 Aug 09 02:45:42.997487 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 345/670] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:45:42 2022] GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d => generated 1688 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:45:43.318101 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-f8b6825f-cb4a-4802-b5ff-5dec20c5166d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:43.318785 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-f8b6825f-cb4a-4802-b5ff-5dec20c5166d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 1cc38775-2c7d-4558-8ca9-3a2ef4917949] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:43.325257 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f8b6825f-cb4a-4802-b5ff-5dec20c5166d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:43.325743 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f8b6825f-cb4a-4802-b5ff-5dec20c5166d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:43.326198 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f8b6825f-cb4a-4802-b5ff-5dec20c5166d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:43.326915 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f8b6825f-cb4a-4802-b5ff-5dec20c5166d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:43.327361 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f8b6825f-cb4a-4802-b5ff-5dec20c5166d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:43.327779 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f8b6825f-cb4a-4802-b5ff-5dec20c5166d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:43.389681 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-f8b6825f-cb4a-4802-b5ff-5dec20c5166d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:43.397420 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-f8b6825f-cb4a-4802-b5ff-5dec20c5166d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/1cc38775-2c7d-4558-8ca9-3a2ef4917949" status: 200 len: 1245 microversion: 2.1 time: 0.083729 Aug 09 02:45:43.397992 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 326/671] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:45:43 2022] GET /compute/v2.1/servers/1cc38775-2c7d-4558-8ca9-3a2ef4917949 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:45:43.820828 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-61729bd1-965e-486f-a8b1-0d237dcd17fb tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:43.821333 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-61729bd1-965e-486f-a8b1-0d237dcd17fb tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:43.827749 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-61729bd1-965e-486f-a8b1-0d237dcd17fb tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:43.828212 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-61729bd1-965e-486f-a8b1-0d237dcd17fb tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:43.828633 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-61729bd1-965e-486f-a8b1-0d237dcd17fb tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:43.829317 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-61729bd1-965e-486f-a8b1-0d237dcd17fb tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:43.829758 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-61729bd1-965e-486f-a8b1-0d237dcd17fb tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:43.830199 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-61729bd1-965e-486f-a8b1-0d237dcd17fb tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:43.863657 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-61729bd1-965e-486f-a8b1-0d237dcd17fb tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73/os-volume_attachments/d9a0ac98-01fb-45fd-a3a0-00fed8f329d3" status: 200 len: 194 microversion: 2.20 time: 0.043595 Aug 09 02:45:43.864357 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 346/672] 10.222.0.20 () {60 vars in 1454 bytes} [Tue Aug 9 02:45:43 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73/os-volume_attachments/d9a0ac98-01fb-45fd-a3a0-00fed8f329d3 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 02:45:43.935396 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-119ee609-ea7d-4db7-bc69-21af1f2c07e2 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:43.935888 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-119ee609-ea7d-4db7-bc69-21af1f2c07e2 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:43.941781 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-119ee609-ea7d-4db7-bc69-21af1f2c07e2 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:43.942283 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-119ee609-ea7d-4db7-bc69-21af1f2c07e2 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:43.942714 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-119ee609-ea7d-4db7-bc69-21af1f2c07e2 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:43.943453 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-119ee609-ea7d-4db7-bc69-21af1f2c07e2 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:43.943840 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-119ee609-ea7d-4db7-bc69-21af1f2c07e2 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:43.944254 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-119ee609-ea7d-4db7-bc69-21af1f2c07e2 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:44.017119 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-9c23091b-201a-40d0-a277-abfae76f140d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:44.017732 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-9c23091b-201a-40d0-a277-abfae76f140d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: b9369cf3-95d7-41d2-8157-ca2c165b062d] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:44.023883 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9c23091b-201a-40d0-a277-abfae76f140d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:44.024367 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9c23091b-201a-40d0-a277-abfae76f140d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:44.024800 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9c23091b-201a-40d0-a277-abfae76f140d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:44.025515 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9c23091b-201a-40d0-a277-abfae76f140d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:44.025965 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9c23091b-201a-40d0-a277-abfae76f140d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:44.026408 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9c23091b-201a-40d0-a277-abfae76f140d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:44.027507 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.objects.instance [None req-119ee609-ea7d-4db7-bc69-21af1f2c07e2 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lazy-loading 'services' on Instance uuid 9919dd32-c9e0-42ae-8981-414c2e663e73 {{(pid=124425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 02:45:44.124540 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-119ee609-ea7d-4db7-bc69-21af1f2c07e2 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73/os-volume_attachments/d9a0ac98-01fb-45fd-a3a0-00fed8f329d3" status: 202 len: 0 microversion: 2.20 time: 0.192376 Aug 09 02:45:44.125451 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 327/673] 10.222.0.20 () {60 vars in 1457 bytes} [Tue Aug 9 02:45:43 2022] DELETE /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73/os-volume_attachments/d9a0ac98-01fb-45fd-a3a0-00fed8f329d3 => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 02:45:44.144724 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-878cd2a8-9e8e-4eb4-93a1-d95ccec87253 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:44.155208 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-878cd2a8-9e8e-4eb4-93a1-d95ccec87253 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:44.162145 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-878cd2a8-9e8e-4eb4-93a1-d95ccec87253 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:44.162869 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-878cd2a8-9e8e-4eb4-93a1-d95ccec87253 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:44.163275 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-878cd2a8-9e8e-4eb4-93a1-d95ccec87253 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:44.164167 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-878cd2a8-9e8e-4eb4-93a1-d95ccec87253 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:44.164615 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-878cd2a8-9e8e-4eb4-93a1-d95ccec87253 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:44.166456 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-878cd2a8-9e8e-4eb4-93a1-d95ccec87253 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:44.200679 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-878cd2a8-9e8e-4eb4-93a1-d95ccec87253 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.070230 Aug 09 02:45:44.201166 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 328/674] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Aug 9 02:45:44 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 02:45:44.294083 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-9c23091b-201a-40d0-a277-abfae76f140d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:44.302037 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-9c23091b-201a-40d0-a277-abfae76f140d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d" status: 200 len: 1688 microversion: 2.1 time: 0.289057 Aug 09 02:45:44.302740 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 347/675] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:45:44 2022] GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d => generated 1688 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:45:44.419503 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-34499d10-2d33-4def-ab7d-5e8a45ebee49 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:44.420124 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-34499d10-2d33-4def-ab7d-5e8a45ebee49 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 1cc38775-2c7d-4558-8ca9-3a2ef4917949] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:44.426988 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-34499d10-2d33-4def-ab7d-5e8a45ebee49 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:44.427460 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-34499d10-2d33-4def-ab7d-5e8a45ebee49 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:44.427900 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-34499d10-2d33-4def-ab7d-5e8a45ebee49 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:44.428597 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-34499d10-2d33-4def-ab7d-5e8a45ebee49 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:44.429047 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-34499d10-2d33-4def-ab7d-5e8a45ebee49 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:44.429465 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-34499d10-2d33-4def-ab7d-5e8a45ebee49 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:44.535933 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-34499d10-2d33-4def-ab7d-5e8a45ebee49 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:44.544056 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-34499d10-2d33-4def-ab7d-5e8a45ebee49 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/1cc38775-2c7d-4558-8ca9-3a2ef4917949" status: 200 len: 1293 microversion: 2.1 time: 0.129176 Aug 09 02:45:44.544606 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 329/676] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:45:44 2022] GET /compute/v2.1/servers/1cc38775-2c7d-4558-8ca9-3a2ef4917949 => generated 1293 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:45:45.213315 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-2f490281-1b4d-4cbd-bbfd-3a45f25298ff tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:45.215614 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-2f490281-1b4d-4cbd-bbfd-3a45f25298ff tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:45.222970 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2f490281-1b4d-4cbd-bbfd-3a45f25298ff tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:45.223544 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2f490281-1b4d-4cbd-bbfd-3a45f25298ff tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:45.224164 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2f490281-1b4d-4cbd-bbfd-3a45f25298ff tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:45.224890 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2f490281-1b4d-4cbd-bbfd-3a45f25298ff tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:45.225332 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2f490281-1b4d-4cbd-bbfd-3a45f25298ff tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:45.225750 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2f490281-1b4d-4cbd-bbfd-3a45f25298ff tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:45.263867 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-2f490281-1b4d-4cbd-bbfd-3a45f25298ff tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054601 Aug 09 02:45:45.264909 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 348/677] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Aug 9 02:45:45 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 02:45:45.323827 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-d488eb1f-0e84-486a-ae3f-68d4a6a5b634 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:45.324540 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-d488eb1f-0e84-486a-ae3f-68d4a6a5b634 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: b9369cf3-95d7-41d2-8157-ca2c165b062d] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:45.331085 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d488eb1f-0e84-486a-ae3f-68d4a6a5b634 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:45.331833 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d488eb1f-0e84-486a-ae3f-68d4a6a5b634 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:45.332264 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d488eb1f-0e84-486a-ae3f-68d4a6a5b634 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:45.332961 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d488eb1f-0e84-486a-ae3f-68d4a6a5b634 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:45.333433 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d488eb1f-0e84-486a-ae3f-68d4a6a5b634 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:45.334071 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d488eb1f-0e84-486a-ae3f-68d4a6a5b634 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:45.425443 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [req-f5aff95d-4e36-4c6e-a098-aa4ed24e0e46 req-c6941ddb-7b24-4988-86fa-9adbced0645f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9369cf3-95d7-41d2-8157-ca2c165b062d", "name": "network-vif-deleted", "tag": "5340ab1c-d934-4cfa-bf83-c7ba28e47a66"}]} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:45:45.437206 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-f5aff95d-4e36-4c6e-a098-aa4ed24e0e46 req-c6941ddb-7b24-4988-86fa-9adbced0645f service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:45.437756 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-f5aff95d-4e36-4c6e-a098-aa4ed24e0e46 req-c6941ddb-7b24-4988-86fa-9adbced0645f service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:45.439836 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-f5aff95d-4e36-4c6e-a098-aa4ed24e0e46 req-c6941ddb-7b24-4988-86fa-9adbced0645f service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:45.440843 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-d488eb1f-0e84-486a-ae3f-68d4a6a5b634 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:45.450465 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-d488eb1f-0e84-486a-ae3f-68d4a6a5b634 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d" status: 200 len: 1620 microversion: 2.1 time: 0.130629 Aug 09 02:45:45.451048 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 330/678] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:45:45 2022] GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d => generated 1620 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:45:45.465929 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.compute.server_external_events [req-f5aff95d-4e36-4c6e-a098-aa4ed24e0e46 req-c6941ddb-7b24-4988-86fa-9adbced0645f service nova] Creating event network-vif-deleted:5340ab1c-d934-4cfa-bf83-c7ba28e47a66 for instance b9369cf3-95d7-41d2-8157-ca2c165b062d on hv-cinder-85246 Aug 09 02:45:45.471306 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [req-f5aff95d-4e36-4c6e-a098-aa4ed24e0e46 req-c6941ddb-7b24-4988-86fa-9adbced0645f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055752 Aug 09 02:45:45.471950 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 349/679] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:45:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:45:45.566943 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-73de7ced-1719-42a4-905e-4d52269312bd tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:45.568224 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-73de7ced-1719-42a4-905e-4d52269312bd tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 1cc38775-2c7d-4558-8ca9-3a2ef4917949] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:45.575831 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-73de7ced-1719-42a4-905e-4d52269312bd tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:45.576399 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-73de7ced-1719-42a4-905e-4d52269312bd tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:45.576901 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-73de7ced-1719-42a4-905e-4d52269312bd tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:45.577673 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-73de7ced-1719-42a4-905e-4d52269312bd tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:45.578126 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-73de7ced-1719-42a4-905e-4d52269312bd tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:45.578577 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-73de7ced-1719-42a4-905e-4d52269312bd tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:45.582862 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:45:45.692294 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-73de7ced-1719-42a4-905e-4d52269312bd tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:45.700557 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-73de7ced-1719-42a4-905e-4d52269312bd tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/1cc38775-2c7d-4558-8ca9-3a2ef4917949" status: 200 len: 1299 microversion: 2.1 time: 0.139235 Aug 09 02:45:45.701230 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 331/680] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:45:45 2022] GET /compute/v2.1/servers/1cc38775-2c7d-4558-8ca9-3a2ef4917949 => generated 1299 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:45:46.276689 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-dc60d683-6c1d-48e2-ace6-8ec282d3286d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:46.279035 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-dc60d683-6c1d-48e2-ace6-8ec282d3286d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:46.286659 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-dc60d683-6c1d-48e2-ace6-8ec282d3286d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:46.287481 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-dc60d683-6c1d-48e2-ace6-8ec282d3286d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:46.288159 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-dc60d683-6c1d-48e2-ace6-8ec282d3286d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:46.289105 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-dc60d683-6c1d-48e2-ace6-8ec282d3286d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:46.289645 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-dc60d683-6c1d-48e2-ace6-8ec282d3286d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:46.290127 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-dc60d683-6c1d-48e2-ace6-8ec282d3286d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:46.326221 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-dc60d683-6c1d-48e2-ace6-8ec282d3286d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.054006 Aug 09 02:45:46.334437 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 350/681] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Aug 9 02:45:46 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:45:46.392389 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-066986f9-301a-4e77-be43-5fec5c89a9d0 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:46.392887 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-066986f9-301a-4e77-be43-5fec5c89a9d0 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:46.399907 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-066986f9-301a-4e77-be43-5fec5c89a9d0 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:46.400391 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-066986f9-301a-4e77-be43-5fec5c89a9d0 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:46.400820 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-066986f9-301a-4e77-be43-5fec5c89a9d0 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:46.401516 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-066986f9-301a-4e77-be43-5fec5c89a9d0 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:46.401989 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-066986f9-301a-4e77-be43-5fec5c89a9d0 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:46.402401 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-066986f9-301a-4e77-be43-5fec5c89a9d0 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:46.436008 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-066986f9-301a-4e77-be43-5fec5c89a9d0 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Going to try to terminate instance {{(pid=124425) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 02:45:46.473519 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-60861106-e66a-4f36-a8c5-5bd0c3d30c74 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:46.474138 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-60861106-e66a-4f36-a8c5-5bd0c3d30c74 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: b9369cf3-95d7-41d2-8157-ca2c165b062d] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:46.481944 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-60861106-e66a-4f36-a8c5-5bd0c3d30c74 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:46.482943 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-60861106-e66a-4f36-a8c5-5bd0c3d30c74 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:46.484625 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-60861106-e66a-4f36-a8c5-5bd0c3d30c74 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:46.486726 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-60861106-e66a-4f36-a8c5-5bd0c3d30c74 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:46.487819 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-60861106-e66a-4f36-a8c5-5bd0c3d30c74 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:46.488591 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-60861106-e66a-4f36-a8c5-5bd0c3d30c74 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:46.506492 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.wsgi [None req-60861106-e66a-4f36-a8c5-5bd0c3d30c74 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] HTTP exception thrown: Instance b9369cf3-95d7-41d2-8157-ca2c165b062d could not be found. Aug 09 02:45:46.509725 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-60861106-e66a-4f36-a8c5-5bd0c3d30c74 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Request method failure captured: Aug 09 02:45:46.509725 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: request: GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d HTTP/1.1 Aug 09 02:45:46.509725 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Accept: application/json Aug 09 02:45:46.509725 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Accept-Encoding: identity Aug 09 02:45:46.509725 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Connection: close Aug 09 02:45:46.509725 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Content-Length: 0 Aug 09 02:45:46.509725 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Content-Type: application/json Aug 09 02:45:46.509725 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Host: 10.222.0.20 Aug 09 02:45:46.509725 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Openstack-System-Scope: None Aug 09 02:45:46.509725 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: User-Agent: python-urllib3/1.26.11 Aug 09 02:45:46.509725 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Auth-Token: gAAAAABi8ck0CktcbMqTyHyXW8raM7iadadJrEMEsJe1QuxYKiBhpTouij9hVxYkaHqXy09_JT1eLz1wDM3rcA0s4PsRbPJ5NcIAOnut9F1rfjVmZ0ZLJHay53lPPXa7QLsuxiazoAiezHqBT1Xd8Rz6-J34U6-EpZWhwazb9UjXN8mMBEdn5c0 Aug 09 02:45:46.509725 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Domain-Id: None Aug 09 02:45:46.509725 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Domain-Name: None Aug 09 02:45:46.509725 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Identity-Status: Confirmed Aug 09 02:45:46.509725 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Is-Admin-Project: True Aug 09 02:45:46.509725 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Domain-Id: default Aug 09 02:45:46.509725 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Domain-Name: Default Aug 09 02:45:46.509725 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Id: 65aab6ab3ce94cbd93916edf9c3eedc0 Aug 09 02:45:46.509725 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-806361088 Aug 09 02:45:46.509725 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Role: reader,member Aug 09 02:45:46.509725 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Roles: reader,member Aug 09 02:45:46.511339 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/65aab6ab3ce94cbd93916edf9c3eedc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/65aab6ab3ce94cbd93916edf9c3eedc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_65aab6ab3ce94cbd93916edf9c3eedc0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/65aab6ab3ce94cbd93916edf9c3eedc0"}]}] Aug 09 02:45:46.511339 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant: tempest-ServerRescueNegativeTestJSON-806361088 Aug 09 02:45:46.511339 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant-Id: 65aab6ab3ce94cbd93916edf9c3eedc0 Aug 09 02:45:46.511339 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-806361088 Aug 09 02:45:46.511339 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User: tempest-ServerRescueNegativeTestJSON-806361088-project Aug 09 02:45:46.511339 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Domain-Id: default Aug 09 02:45:46.511339 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Domain-Name: Default Aug 09 02:45:46.511339 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Id: 192a8abd4c7a4535a42bea7648535dc3 Aug 09 02:45:46.511339 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Name: tempest-ServerRescueNegativeTestJSON-806361088-project Aug 09 02:45:46.511339 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: method: > Aug 09 02:45:46.511339 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: exception: Instance b9369cf3-95d7-41d2-8157-ca2c165b062d could not be found. Aug 09 02:45:46.511339 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: action_args: {'id': 'b9369cf3-95d7-41d2-8157-ca2c165b062d'} Aug 09 02:45:46.512140 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 02:45:46.512140 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:45:46.512140 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 02:45:46.512140 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 02:45:46.512140 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 02:45:46.512140 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 02:45:46.512140 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 02:45:46.512140 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 02:45:46.512140 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 02:45:46.512140 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 02:45:46.512140 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9369cf3-95d7-41d2-8157-ca2c165b062d could not be found. Aug 09 02:45:46.512140 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:45:46.512140 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:45:46.512140 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:45:46.512140 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:45:46.512140 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:45:46.512140 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:45:46.512140 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 02:45:46.512140 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 02:45:46.512140 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 02:45:46.513407 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 02:45:46.513407 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 02:45:46.513407 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 02:45:46.513407 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 02:45:46.513407 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 02:45:46.513407 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 02:45:46.513407 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 02:45:46.513407 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9369cf3-95d7-41d2-8157-ca2c165b062d could not be found. Aug 09 02:45:46.513407 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:45:46.513407 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:45:46.513407 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:45:46.513407 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:45:46.513407 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:45:46.513407 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:45:46.513407 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 02:45:46.513407 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 02:45:46.513407 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9369cf3-95d7-41d2-8157-ca2c165b062d could not be found. Aug 09 02:45:46.513407 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:45:46.516402 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-60861106-e66a-4f36-a8c5-5bd0c3d30c74 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Returning 404 to user: Instance b9369cf3-95d7-41d2-8157-ca2c165b062d could not be found. {{(pid=124427) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 02:45:46.518121 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-60861106-e66a-4f36-a8c5-5bd0c3d30c74 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d" status: 404 len: 111 microversion: 2.1 time: 0.049617 Aug 09 02:45:46.519387 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 351/682] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:45:46 2022] GET /compute/v2.1/servers/b9369cf3-95d7-41d2-8157-ca2c165b062d => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 02:45:46.527571 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-7d14cfdd-28bb-47cf-90ed-8f0dcf75590b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '.version_select at 0x7fb0a0307550>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:46.551999 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-066986f9-301a-4e77-be43-5fec5c89a9d0 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 204 len: 0 microversion: 2.20 time: 0.163193 Aug 09 02:45:46.553732 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 332/683] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Aug 9 02:45:46 2022] DELETE /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 02:45:46.563850 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-63beb1d0-c930-44c7-8e20-ff16b9281536 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:46.565958 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-63beb1d0-c930-44c7-8e20-ff16b9281536 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:46.570871 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-7d14cfdd-28bb-47cf-90ed-8f0dcf75590b tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-142490633" status: 202 len: 0 microversion: 2.1 time: 0.046838 Aug 09 02:45:46.572237 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 352/684] 10.222.0.20 () {58 vars in 1218 bytes} [Tue Aug 9 02:45:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-142490633 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 02:45:46.576074 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-63beb1d0-c930-44c7-8e20-ff16b9281536 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:46.576670 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-63beb1d0-c930-44c7-8e20-ff16b9281536 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:46.577200 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-63beb1d0-c930-44c7-8e20-ff16b9281536 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:46.578050 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-63beb1d0-c930-44c7-8e20-ff16b9281536 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:46.578614 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-63beb1d0-c930-44c7-8e20-ff16b9281536 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:46.579150 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-63beb1d0-c930-44c7-8e20-ff16b9281536 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:46.721720 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-3260d067-3bb9-43a1-8a33-1e9758d611f0 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:46.722299 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-3260d067-3bb9-43a1-8a33-1e9758d611f0 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 1cc38775-2c7d-4558-8ca9-3a2ef4917949] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:46.729255 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3260d067-3bb9-43a1-8a33-1e9758d611f0 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:46.729746 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3260d067-3bb9-43a1-8a33-1e9758d611f0 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:46.730170 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3260d067-3bb9-43a1-8a33-1e9758d611f0 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:46.730887 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3260d067-3bb9-43a1-8a33-1e9758d611f0 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:46.731335 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3260d067-3bb9-43a1-8a33-1e9758d611f0 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:46.731893 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3260d067-3bb9-43a1-8a33-1e9758d611f0 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:46.941160 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-63beb1d0-c930-44c7-8e20-ff16b9281536 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:46.949340 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-63beb1d0-c930-44c7-8e20-ff16b9281536 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:46.950871 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-63beb1d0-c930-44c7-8e20-ff16b9281536 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:46.952035 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-63beb1d0-c930-44c7-8e20-ff16b9281536 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1724 microversion: 2.20 time: 0.393632 Aug 09 02:45:46.952600 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 333/685] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:45:46 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1724 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:45:47.047751 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-3260d067-3bb9-43a1-8a33-1e9758d611f0 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:47.058619 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-3260d067-3bb9-43a1-8a33-1e9758d611f0 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/1cc38775-2c7d-4558-8ca9-3a2ef4917949" status: 200 len: 1366 microversion: 2.1 time: 0.341033 Aug 09 02:45:47.070475 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 353/686] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:45:46 2022] GET /compute/v2.1/servers/1cc38775-2c7d-4558-8ca9-3a2ef4917949 => generated 1366 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:45:47.487639 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [req-2cfe6507-4d0d-42b9-9fa4-e6146e95b32e req-ec07792f-86d3-4c6a-ad64-9f84889ed6f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cc38775-2c7d-4558-8ca9-3a2ef4917949", "tag": "788bd99b-2ce6-4f25-9014-bd68dbaaa698"}]} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:45:47.498420 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-2cfe6507-4d0d-42b9-9fa4-e6146e95b32e req-ec07792f-86d3-4c6a-ad64-9f84889ed6f2 service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:47.498900 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-2cfe6507-4d0d-42b9-9fa4-e6146e95b32e req-ec07792f-86d3-4c6a-ad64-9f84889ed6f2 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:47.499324 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-2cfe6507-4d0d-42b9-9fa4-e6146e95b32e req-ec07792f-86d3-4c6a-ad64-9f84889ed6f2 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:47.510507 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.compute.server_external_events [req-2cfe6507-4d0d-42b9-9fa4-e6146e95b32e req-ec07792f-86d3-4c6a-ad64-9f84889ed6f2 service nova] Creating event network-changed:788bd99b-2ce6-4f25-9014-bd68dbaaa698 for instance 1cc38775-2c7d-4558-8ca9-3a2ef4917949 on hv-cinder-85246 Aug 09 02:45:47.515133 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [req-2cfe6507-4d0d-42b9-9fa4-e6146e95b32e req-ec07792f-86d3-4c6a-ad64-9f84889ed6f2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031700 Aug 09 02:45:47.515724 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 334/687] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:45:47.975383 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-6243b68d-c376-406c-96bb-72df1b853a41 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:47.975991 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-6243b68d-c376-406c-96bb-72df1b853a41 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:47.978490 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=2,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:45:47.983367 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6243b68d-c376-406c-96bb-72df1b853a41 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:47.983872 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6243b68d-c376-406c-96bb-72df1b853a41 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:47.984298 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6243b68d-c376-406c-96bb-72df1b853a41 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:47.984974 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6243b68d-c376-406c-96bb-72df1b853a41 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:47.985781 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6243b68d-c376-406c-96bb-72df1b853a41 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:47.986229 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6243b68d-c376-406c-96bb-72df1b853a41 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:48.079737 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-6a099187-b4b1-4ab9-8c49-f465e2963fbe tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:48.080329 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-6a099187-b4b1-4ab9-8c49-f465e2963fbe tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 1cc38775-2c7d-4558-8ca9-3a2ef4917949] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:48.087247 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6a099187-b4b1-4ab9-8c49-f465e2963fbe tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:48.087694 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6a099187-b4b1-4ab9-8c49-f465e2963fbe tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:48.088151 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6a099187-b4b1-4ab9-8c49-f465e2963fbe tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:48.088880 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6a099187-b4b1-4ab9-8c49-f465e2963fbe tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:48.089323 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6a099187-b4b1-4ab9-8c49-f465e2963fbe tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:48.089711 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6a099187-b4b1-4ab9-8c49-f465e2963fbe tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:48.123529 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-6243b68d-c376-406c-96bb-72df1b853a41 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:48.132293 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-6243b68d-c376-406c-96bb-72df1b853a41 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:48.133856 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-6243b68d-c376-406c-96bb-72df1b853a41 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:48.135094 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-6243b68d-c376-406c-96bb-72df1b853a41 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1724 microversion: 2.20 time: 0.163700 Aug 09 02:45:48.135629 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 354/688] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:45:47 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:45:48.274478 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-6a099187-b4b1-4ab9-8c49-f465e2963fbe tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:48.282008 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-6a099187-b4b1-4ab9-8c49-f465e2963fbe tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/1cc38775-2c7d-4558-8ca9-3a2ef4917949" status: 200 len: 1366 microversion: 2.1 time: 0.206748 Aug 09 02:45:48.282633 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 335/689] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:45:48 2022] GET /compute/v2.1/servers/1cc38775-2c7d-4558-8ca9-3a2ef4917949 => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:45:49.158128 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-44118980-e324-4f9e-a09e-d2de835eb037 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:49.159483 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-44118980-e324-4f9e-a09e-d2de835eb037 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:49.166831 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-44118980-e324-4f9e-a09e-d2de835eb037 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:49.167584 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-44118980-e324-4f9e-a09e-d2de835eb037 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:49.167983 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-44118980-e324-4f9e-a09e-d2de835eb037 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:49.168666 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-44118980-e324-4f9e-a09e-d2de835eb037 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:49.169114 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-44118980-e324-4f9e-a09e-d2de835eb037 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:49.169614 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-44118980-e324-4f9e-a09e-d2de835eb037 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:49.302821 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-c02bc5f6-fbc5-4edf-8227-02c67977f89a tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:49.303427 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-c02bc5f6-fbc5-4edf-8227-02c67977f89a tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 1cc38775-2c7d-4558-8ca9-3a2ef4917949] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:49.310020 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c02bc5f6-fbc5-4edf-8227-02c67977f89a tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:49.310757 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c02bc5f6-fbc5-4edf-8227-02c67977f89a tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:49.311186 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c02bc5f6-fbc5-4edf-8227-02c67977f89a tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:49.311870 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c02bc5f6-fbc5-4edf-8227-02c67977f89a tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:49.312313 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c02bc5f6-fbc5-4edf-8227-02c67977f89a tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:49.312733 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c02bc5f6-fbc5-4edf-8227-02c67977f89a tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:49.425356 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-44118980-e324-4f9e-a09e-d2de835eb037 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:49.434177 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-44118980-e324-4f9e-a09e-d2de835eb037 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:49.435722 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-44118980-e324-4f9e-a09e-d2de835eb037 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:49.437183 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-44118980-e324-4f9e-a09e-d2de835eb037 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1724 microversion: 2.20 time: 0.283117 Aug 09 02:45:49.437748 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 355/690] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:45:49 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1724 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:45:49.769545 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-e4bc5f7a-d110-4c91-bfd8-63389e68a9b5 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:49.770053 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-e4bc5f7a-d110-4c91-bfd8-63389e68a9b5 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:49.776170 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e4bc5f7a-d110-4c91-bfd8-63389e68a9b5 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:49.776653 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e4bc5f7a-d110-4c91-bfd8-63389e68a9b5 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:49.777435 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e4bc5f7a-d110-4c91-bfd8-63389e68a9b5 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:49.778208 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e4bc5f7a-d110-4c91-bfd8-63389e68a9b5 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:49.778665 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e4bc5f7a-d110-4c91-bfd8-63389e68a9b5 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:49.779101 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e4bc5f7a-d110-4c91-bfd8-63389e68a9b5 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:49.786603 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-c02bc5f6-fbc5-4edf-8227-02c67977f89a tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:49.802968 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-c02bc5f6-fbc5-4edf-8227-02c67977f89a tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/1cc38775-2c7d-4558-8ca9-3a2ef4917949" status: 200 len: 1366 microversion: 2.1 time: 0.504050 Aug 09 02:45:49.804274 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 336/691] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:45:49 2022] GET /compute/v2.1/servers/1cc38775-2c7d-4558-8ca9-3a2ef4917949 => generated 1366 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:45:49.821256 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-e4bc5f7a-d110-4c91-bfd8-63389e68a9b5 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Going to try to terminate instance {{(pid=124427) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 02:45:49.903181 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-e4bc5f7a-d110-4c91-bfd8-63389e68a9b5 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507" status: 204 len: 0 microversion: 2.1 time: 0.137067 Aug 09 02:45:49.913034 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-f9e7a204-5140-4abe-ae4f-304fc7fa1f9d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:49.913655 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-f9e7a204-5140-4abe-ae4f-304fc7fa1f9d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:49.914243 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 356/692] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 9 02:45:49 2022] DELETE /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 02:45:49.916835 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_cell0:SELECT=2 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:45:49.921050 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f9e7a204-5140-4abe-ae4f-304fc7fa1f9d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:49.921564 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f9e7a204-5140-4abe-ae4f-304fc7fa1f9d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:49.922217 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f9e7a204-5140-4abe-ae4f-304fc7fa1f9d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:49.923124 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f9e7a204-5140-4abe-ae4f-304fc7fa1f9d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:49.923725 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f9e7a204-5140-4abe-ae4f-304fc7fa1f9d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:49.924457 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f9e7a204-5140-4abe-ae4f-304fc7fa1f9d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:49.946093 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_cell0:SELECT=10 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:45:49.956461 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [req-a39c6503-6e69-41f8-88a1-41cdca33d2ae req-65e7a11a-6c3b-4d0a-8d1f-ad9f80745635 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9919dd32-c9e0-42ae-8981-414c2e663e73", "name": "network-vif-deleted", "tag": "e32a0be8-e008-4397-89d0-66d5a85e0515"}]} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:45:49.965743 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-a39c6503-6e69-41f8-88a1-41cdca33d2ae req-65e7a11a-6c3b-4d0a-8d1f-ad9f80745635 service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:49.966235 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-a39c6503-6e69-41f8-88a1-41cdca33d2ae req-65e7a11a-6c3b-4d0a-8d1f-ad9f80745635 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:49.966657 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-a39c6503-6e69-41f8-88a1-41cdca33d2ae req-65e7a11a-6c3b-4d0a-8d1f-ad9f80745635 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:49.978339 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.compute.server_external_events [req-a39c6503-6e69-41f8-88a1-41cdca33d2ae req-65e7a11a-6c3b-4d0a-8d1f-ad9f80745635 service nova] Creating event network-vif-deleted:e32a0be8-e008-4397-89d0-66d5a85e0515 for instance 9919dd32-c9e0-42ae-8981-414c2e663e73 on hv-cinder-85246 Aug 09 02:45:49.983437 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [req-a39c6503-6e69-41f8-88a1-41cdca33d2ae req-65e7a11a-6c3b-4d0a-8d1f-ad9f80745635 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030987 Aug 09 02:45:49.984324 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 357/693] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:45:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 02:45:50.075597 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-f9e7a204-5140-4abe-ae4f-304fc7fa1f9d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:50.083309 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-f9e7a204-5140-4abe-ae4f-304fc7fa1f9d tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507" status: 200 len: 1507 microversion: 2.1 time: 0.174390 Aug 09 02:45:50.083868 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 337/694] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:45:49 2022] GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507 => generated 1507 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:45:50.457844 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_cell0:SELECT=2 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:45:50.462571 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-de837180-35b4-4244-9a5b-c6f62db4450d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:50.463268 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-de837180-35b4-4244-9a5b-c6f62db4450d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:50.471422 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-de837180-35b4-4244-9a5b-c6f62db4450d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:50.472096 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-de837180-35b4-4244-9a5b-c6f62db4450d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:50.472693 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-de837180-35b4-4244-9a5b-c6f62db4450d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:50.473729 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-de837180-35b4-4244-9a5b-c6f62db4450d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:50.474326 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-de837180-35b4-4244-9a5b-c6f62db4450d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:50.474747 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-de837180-35b4-4244-9a5b-c6f62db4450d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:50.544478 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-de837180-35b4-4244-9a5b-c6f62db4450d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:50.553165 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-de837180-35b4-4244-9a5b-c6f62db4450d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:50.554693 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-de837180-35b4-4244-9a5b-c6f62db4450d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:50.555843 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-de837180-35b4-4244-9a5b-c6f62db4450d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1367 microversion: 2.20 time: 0.099095 Aug 09 02:45:50.556409 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 358/695] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:45:50 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1367 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:45:50.805964 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-9eb92316-cf88-44c7-bac7-04cb14630dc5 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:50.806557 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-9eb92316-cf88-44c7-bac7-04cb14630dc5 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 61f94aa1-75dc-4f43-aa71-284c50dc394c] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:50.813338 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9eb92316-cf88-44c7-bac7-04cb14630dc5 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:50.813814 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9eb92316-cf88-44c7-bac7-04cb14630dc5 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:50.814283 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9eb92316-cf88-44c7-bac7-04cb14630dc5 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:50.814980 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9eb92316-cf88-44c7-bac7-04cb14630dc5 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:50.815577 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9eb92316-cf88-44c7-bac7-04cb14630dc5 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:50.815996 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9eb92316-cf88-44c7-bac7-04cb14630dc5 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:50.824366 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-60a47ea4-7ec4-4777-81ad-bbb3483e32c4 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:50.825241 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-60a47ea4-7ec4-4777-81ad-bbb3483e32c4 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 1cc38775-2c7d-4558-8ca9-3a2ef4917949] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:50.831372 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-60a47ea4-7ec4-4777-81ad-bbb3483e32c4 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:50.831854 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-60a47ea4-7ec4-4777-81ad-bbb3483e32c4 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:50.832280 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-60a47ea4-7ec4-4777-81ad-bbb3483e32c4 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:50.832969 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-60a47ea4-7ec4-4777-81ad-bbb3483e32c4 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:50.833543 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-60a47ea4-7ec4-4777-81ad-bbb3483e32c4 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:50.834096 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-60a47ea4-7ec4-4777-81ad-bbb3483e32c4 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:50.845902 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-9eb92316-cf88-44c7-bac7-04cb14630dc5 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 61f94aa1-75dc-4f43-aa71-284c50dc394c] Going to try to terminate instance {{(pid=124425) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 02:45:50.937749 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-9eb92316-cf88-44c7-bac7-04cb14630dc5 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "DELETE /compute/v2.1/servers/61f94aa1-75dc-4f43-aa71-284c50dc394c" status: 204 len: 0 microversion: 2.1 time: 0.135503 Aug 09 02:45:50.938577 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 338/696] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 9 02:45:50 2022] DELETE /compute/v2.1/servers/61f94aa1-75dc-4f43-aa71-284c50dc394c => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 02:45:50.946707 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-b4c32b1c-8ea8-4773-8099-174818648e82 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:50.947435 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-b4c32b1c-8ea8-4773-8099-174818648e82 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 61f94aa1-75dc-4f43-aa71-284c50dc394c] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:50.953385 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b4c32b1c-8ea8-4773-8099-174818648e82 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:50.953869 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b4c32b1c-8ea8-4773-8099-174818648e82 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:50.954421 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b4c32b1c-8ea8-4773-8099-174818648e82 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:50.955116 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b4c32b1c-8ea8-4773-8099-174818648e82 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:50.955616 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b4c32b1c-8ea8-4773-8099-174818648e82 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:50.956043 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b4c32b1c-8ea8-4773-8099-174818648e82 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:50.976848 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-60a47ea4-7ec4-4777-81ad-bbb3483e32c4 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:50.984393 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-60a47ea4-7ec4-4777-81ad-bbb3483e32c4 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/1cc38775-2c7d-4558-8ca9-3a2ef4917949" status: 200 len: 1366 microversion: 2.1 time: 0.164148 Aug 09 02:45:50.984953 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 359/697] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:45:50 2022] GET /compute/v2.1/servers/1cc38775-2c7d-4558-8ca9-3a2ef4917949 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:45:51.090733 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-b4c32b1c-8ea8-4773-8099-174818648e82 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:51.099032 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-b4c32b1c-8ea8-4773-8099-174818648e82 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/61f94aa1-75dc-4f43-aa71-284c50dc394c" status: 200 len: 1577 microversion: 2.1 time: 0.156350 Aug 09 02:45:51.099985 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 339/698] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:45:50 2022] GET /compute/v2.1/servers/61f94aa1-75dc-4f43-aa71-284c50dc394c => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:45:51.104546 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-3723e4c2-839d-4429-abfb-f7506c927d0e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:51.105186 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-3723e4c2-839d-4429-abfb-f7506c927d0e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:51.111681 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3723e4c2-839d-4429-abfb-f7506c927d0e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:51.112221 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3723e4c2-839d-4429-abfb-f7506c927d0e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:51.112642 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3723e4c2-839d-4429-abfb-f7506c927d0e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:51.113321 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3723e4c2-839d-4429-abfb-f7506c927d0e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:51.113761 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3723e4c2-839d-4429-abfb-f7506c927d0e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:51.114254 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3723e4c2-839d-4429-abfb-f7506c927d0e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:51.243041 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-3723e4c2-839d-4429-abfb-f7506c927d0e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:51.250872 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-3723e4c2-839d-4429-abfb-f7506c927d0e tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507" status: 200 len: 1507 microversion: 2.1 time: 0.150173 Aug 09 02:45:51.251448 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 360/699] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:45:51 2022] GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507 => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:45:51.578536 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-91321042-3466-49b7-92f1-49f18744b4d4 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:51.579138 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-91321042-3466-49b7-92f1-49f18744b4d4 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:51.585484 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-91321042-3466-49b7-92f1-49f18744b4d4 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:51.585963 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-91321042-3466-49b7-92f1-49f18744b4d4 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:51.586390 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-91321042-3466-49b7-92f1-49f18744b4d4 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:51.587099 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-91321042-3466-49b7-92f1-49f18744b4d4 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:51.587541 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-91321042-3466-49b7-92f1-49f18744b4d4 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:51.587953 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-91321042-3466-49b7-92f1-49f18744b4d4 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:51.652442 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-91321042-3466-49b7-92f1-49f18744b4d4 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:51.663286 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-91321042-3466-49b7-92f1-49f18744b4d4 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:51.665001 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-91321042-3466-49b7-92f1-49f18744b4d4 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:51.666173 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-91321042-3466-49b7-92f1-49f18744b4d4 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1367 microversion: 2.20 time: 0.091660 Aug 09 02:45:51.666706 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 340/700] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:45:51 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1367 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:45:52.010201 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-ccd5f3b9-d970-43a1-9d0d-607f77b32239 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:52.011180 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-ccd5f3b9-d970-43a1-9d0d-607f77b32239 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 1cc38775-2c7d-4558-8ca9-3a2ef4917949] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:52.022121 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ccd5f3b9-d970-43a1-9d0d-607f77b32239 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:52.022967 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ccd5f3b9-d970-43a1-9d0d-607f77b32239 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:52.023674 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ccd5f3b9-d970-43a1-9d0d-607f77b32239 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:52.025014 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ccd5f3b9-d970-43a1-9d0d-607f77b32239 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:52.025893 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ccd5f3b9-d970-43a1-9d0d-607f77b32239 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:52.026643 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ccd5f3b9-d970-43a1-9d0d-607f77b32239 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:52.120901 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-4debf3c5-56df-4dc1-bea5-e8aebc304570 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:52.121483 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-4debf3c5-56df-4dc1-bea5-e8aebc304570 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 61f94aa1-75dc-4f43-aa71-284c50dc394c] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:52.128640 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4debf3c5-56df-4dc1-bea5-e8aebc304570 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:52.129107 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4debf3c5-56df-4dc1-bea5-e8aebc304570 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:52.129736 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4debf3c5-56df-4dc1-bea5-e8aebc304570 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:52.130452 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4debf3c5-56df-4dc1-bea5-e8aebc304570 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:52.130899 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4debf3c5-56df-4dc1-bea5-e8aebc304570 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:52.131297 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4debf3c5-56df-4dc1-bea5-e8aebc304570 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:52.166627 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-ccd5f3b9-d970-43a1-9d0d-607f77b32239 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:52.175066 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-ccd5f3b9-d970-43a1-9d0d-607f77b32239 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/1cc38775-2c7d-4558-8ca9-3a2ef4917949" status: 200 len: 1366 microversion: 2.1 time: 0.171447 Aug 09 02:45:52.175660 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 361/701] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:45:52 2022] GET /compute/v2.1/servers/1cc38775-2c7d-4558-8ca9-3a2ef4917949 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:45:52.263446 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-4debf3c5-56df-4dc1-bea5-e8aebc304570 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:52.271625 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-4debf3c5-56df-4dc1-bea5-e8aebc304570 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/61f94aa1-75dc-4f43-aa71-284c50dc394c" status: 200 len: 1577 microversion: 2.1 time: 0.154554 Aug 09 02:45:52.272072 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-85caab60-bc44-47c1-bae0-554867c10bcd tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:52.275582 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 341/702] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:45:52 2022] GET /compute/v2.1/servers/61f94aa1-75dc-4f43-aa71-284c50dc394c => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:45:52.275745 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-85caab60-bc44-47c1-bae0-554867c10bcd tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:52.279816 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-85caab60-bc44-47c1-bae0-554867c10bcd tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:52.280373 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-85caab60-bc44-47c1-bae0-554867c10bcd tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:52.280871 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-85caab60-bc44-47c1-bae0-554867c10bcd tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:52.281642 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-85caab60-bc44-47c1-bae0-554867c10bcd tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:52.282148 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-85caab60-bc44-47c1-bae0-554867c10bcd tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:52.282803 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-85caab60-bc44-47c1-bae0-554867c10bcd tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:52.287276 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:45:52.420703 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-85caab60-bc44-47c1-bae0-554867c10bcd tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:52.428313 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-85caab60-bc44-47c1-bae0-554867c10bcd tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507" status: 200 len: 1507 microversion: 2.1 time: 0.160465 Aug 09 02:45:52.428905 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 362/703] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:45:52 2022] GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507 => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:45:52.693298 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-e76babc9-0b7c-480d-a114-3b7d4fc476da tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:52.694334 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-e76babc9-0b7c-480d-a114-3b7d4fc476da tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:52.704397 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e76babc9-0b7c-480d-a114-3b7d4fc476da tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:52.705184 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e76babc9-0b7c-480d-a114-3b7d4fc476da tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:52.705971 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e76babc9-0b7c-480d-a114-3b7d4fc476da tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:52.706683 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e76babc9-0b7c-480d-a114-3b7d4fc476da tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:52.707124 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e76babc9-0b7c-480d-a114-3b7d4fc476da tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:52.707538 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e76babc9-0b7c-480d-a114-3b7d4fc476da tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:52.733493 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:45:52.739142 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e76babc9-0b7c-480d-a114-3b7d4fc476da tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:52.739603 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e76babc9-0b7c-480d-a114-3b7d4fc476da tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:52.740033 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e76babc9-0b7c-480d-a114-3b7d4fc476da tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:52.740551 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.objects.instance [None req-e76babc9-0b7c-480d-a114-3b7d4fc476da tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lazy-loading 'fault' on Instance uuid 9919dd32-c9e0-42ae-8981-414c2e663e73 {{(pid=124425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 02:45:52.782305 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-e76babc9-0b7c-480d-a114-3b7d4fc476da tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:52.790452 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-e76babc9-0b7c-480d-a114-3b7d4fc476da tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:52.791933 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-e76babc9-0b7c-480d-a114-3b7d4fc476da tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:52.793141 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-e76babc9-0b7c-480d-a114-3b7d4fc476da tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1372 microversion: 2.20 time: 0.106495 Aug 09 02:45:52.793675 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 342/704] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:45:52 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1372 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:45:53.200050 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-6e2a5db8-928a-47dd-b3e9-36f5d65bac59 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:53.201118 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-6e2a5db8-928a-47dd-b3e9-36f5d65bac59 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 1cc38775-2c7d-4558-8ca9-3a2ef4917949] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:53.209814 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6e2a5db8-928a-47dd-b3e9-36f5d65bac59 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:53.210330 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6e2a5db8-928a-47dd-b3e9-36f5d65bac59 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:53.210759 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6e2a5db8-928a-47dd-b3e9-36f5d65bac59 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:53.211451 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6e2a5db8-928a-47dd-b3e9-36f5d65bac59 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:53.211891 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6e2a5db8-928a-47dd-b3e9-36f5d65bac59 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:53.212316 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6e2a5db8-928a-47dd-b3e9-36f5d65bac59 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:53.293205 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-707e6f18-effb-47a5-9192-fd1fe2239dd7 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:53.293784 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-707e6f18-effb-47a5-9192-fd1fe2239dd7 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 61f94aa1-75dc-4f43-aa71-284c50dc394c] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:53.301691 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-707e6f18-effb-47a5-9192-fd1fe2239dd7 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:53.302192 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-707e6f18-effb-47a5-9192-fd1fe2239dd7 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:53.302665 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-707e6f18-effb-47a5-9192-fd1fe2239dd7 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:53.303378 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-707e6f18-effb-47a5-9192-fd1fe2239dd7 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:53.303837 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-707e6f18-effb-47a5-9192-fd1fe2239dd7 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:53.304495 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-707e6f18-effb-47a5-9192-fd1fe2239dd7 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:53.349328 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-6e2a5db8-928a-47dd-b3e9-36f5d65bac59 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:53.357439 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-6e2a5db8-928a-47dd-b3e9-36f5d65bac59 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/1cc38775-2c7d-4558-8ca9-3a2ef4917949" status: 200 len: 1366 microversion: 2.1 time: 0.163882 Aug 09 02:45:53.358277 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 363/705] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:45:53 2022] GET /compute/v2.1/servers/1cc38775-2c7d-4558-8ca9-3a2ef4917949 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:45:53.452455 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-707e6f18-effb-47a5-9192-fd1fe2239dd7 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:53.460525 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-707e6f18-effb-47a5-9192-fd1fe2239dd7 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/61f94aa1-75dc-4f43-aa71-284c50dc394c" status: 200 len: 1577 microversion: 2.1 time: 0.171416 Aug 09 02:45:53.461101 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 343/706] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:45:53 2022] GET /compute/v2.1/servers/61f94aa1-75dc-4f43-aa71-284c50dc394c => generated 1577 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:45:53.550737 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-e57c5217-1c79-45ed-9ab5-a8aae4d50f01 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:53.551351 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-e57c5217-1c79-45ed-9ab5-a8aae4d50f01 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:53.557366 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e57c5217-1c79-45ed-9ab5-a8aae4d50f01 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:53.557853 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e57c5217-1c79-45ed-9ab5-a8aae4d50f01 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:53.558297 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e57c5217-1c79-45ed-9ab5-a8aae4d50f01 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:53.559015 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e57c5217-1c79-45ed-9ab5-a8aae4d50f01 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:53.559461 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e57c5217-1c79-45ed-9ab5-a8aae4d50f01 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:53.559876 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e57c5217-1c79-45ed-9ab5-a8aae4d50f01 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:53.657750 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [req-7165478e-0acb-4964-9a87-d956a7b54048 req-62125fa5-2e42-4b80-ac2c-8465e9da9009 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cc38775-2c7d-4558-8ca9-3a2ef4917949", "name": "network-vif-plugged", "status": "completed", "tag": "788bd99b-2ce6-4f25-9014-bd68dbaaa698"}]} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:45:53.669485 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-7165478e-0acb-4964-9a87-d956a7b54048 req-62125fa5-2e42-4b80-ac2c-8465e9da9009 service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:53.670184 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-7165478e-0acb-4964-9a87-d956a7b54048 req-62125fa5-2e42-4b80-ac2c-8465e9da9009 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:53.671349 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-7165478e-0acb-4964-9a87-d956a7b54048 req-62125fa5-2e42-4b80-ac2c-8465e9da9009 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:53.685225 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.compute.server_external_events [req-7165478e-0acb-4964-9a87-d956a7b54048 req-62125fa5-2e42-4b80-ac2c-8465e9da9009 service nova] Creating event network-vif-plugged:788bd99b-2ce6-4f25-9014-bd68dbaaa698 for instance 1cc38775-2c7d-4558-8ca9-3a2ef4917949 on hv-cinder-85246 Aug 09 02:45:53.691539 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [req-7165478e-0acb-4964-9a87-d956a7b54048 req-62125fa5-2e42-4b80-ac2c-8465e9da9009 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038414 Aug 09 02:45:53.692151 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 344/707] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:45:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 02:45:53.694061 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-e57c5217-1c79-45ed-9ab5-a8aae4d50f01 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:53.701930 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-e57c5217-1c79-45ed-9ab5-a8aae4d50f01 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507" status: 200 len: 1507 microversion: 2.1 time: 0.256821 Aug 09 02:45:53.702763 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 364/708] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:45:53 2022] GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507 => generated 1507 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:45:53.820079 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-4b482f72-dbf1-4fdd-a6e1-c380135b889f tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:53.820996 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-4b482f72-dbf1-4fdd-a6e1-c380135b889f tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:53.829584 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4b482f72-dbf1-4fdd-a6e1-c380135b889f tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:53.830219 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4b482f72-dbf1-4fdd-a6e1-c380135b889f tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:53.830831 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4b482f72-dbf1-4fdd-a6e1-c380135b889f tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:53.831730 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4b482f72-dbf1-4fdd-a6e1-c380135b889f tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:53.832321 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4b482f72-dbf1-4fdd-a6e1-c380135b889f tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:53.832871 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4b482f72-dbf1-4fdd-a6e1-c380135b889f tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:53.851264 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:45:53.871286 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4b482f72-dbf1-4fdd-a6e1-c380135b889f tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:53.871762 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4b482f72-dbf1-4fdd-a6e1-c380135b889f tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:53.872194 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4b482f72-dbf1-4fdd-a6e1-c380135b889f tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:53.872633 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.objects.instance [None req-4b482f72-dbf1-4fdd-a6e1-c380135b889f tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lazy-loading 'fault' on Instance uuid 9919dd32-c9e0-42ae-8981-414c2e663e73 {{(pid=124425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 02:45:53.917450 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-4b482f72-dbf1-4fdd-a6e1-c380135b889f tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:53.925661 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-4b482f72-dbf1-4fdd-a6e1-c380135b889f tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:53.927216 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-4b482f72-dbf1-4fdd-a6e1-c380135b889f tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:53.928368 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-4b482f72-dbf1-4fdd-a6e1-c380135b889f tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 200 len: 1372 microversion: 2.20 time: 0.114489 Aug 09 02:45:53.928929 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 345/709] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:45:53 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 1372 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:45:54.383086 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-86baafa0-fd69-4e44-a974-1ca00965a9f2 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:54.383696 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-86baafa0-fd69-4e44-a974-1ca00965a9f2 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 1cc38775-2c7d-4558-8ca9-3a2ef4917949] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:54.390623 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-86baafa0-fd69-4e44-a974-1ca00965a9f2 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:54.391099 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-86baafa0-fd69-4e44-a974-1ca00965a9f2 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:54.391525 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-86baafa0-fd69-4e44-a974-1ca00965a9f2 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:54.392265 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-86baafa0-fd69-4e44-a974-1ca00965a9f2 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:54.392710 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-86baafa0-fd69-4e44-a974-1ca00965a9f2 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:54.393107 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-86baafa0-fd69-4e44-a974-1ca00965a9f2 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:54.481114 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-05d86b2d-4087-41e6-b386-178ad0d9c4fc tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:54.481754 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-05d86b2d-4087-41e6-b386-178ad0d9c4fc tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 61f94aa1-75dc-4f43-aa71-284c50dc394c] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:54.489294 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-05d86b2d-4087-41e6-b386-178ad0d9c4fc tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:54.489751 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-05d86b2d-4087-41e6-b386-178ad0d9c4fc tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:54.490209 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-05d86b2d-4087-41e6-b386-178ad0d9c4fc tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:54.490922 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-05d86b2d-4087-41e6-b386-178ad0d9c4fc tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:54.491370 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-05d86b2d-4087-41e6-b386-178ad0d9c4fc tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:54.491794 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-05d86b2d-4087-41e6-b386-178ad0d9c4fc tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:54.737364 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-86baafa0-fd69-4e44-a974-1ca00965a9f2 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:54.746401 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-86baafa0-fd69-4e44-a974-1ca00965a9f2 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/1cc38775-2c7d-4558-8ca9-3a2ef4917949" status: 200 len: 1366 microversion: 2.1 time: 0.367129 Aug 09 02:45:54.746985 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 365/710] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:45:54 2022] GET /compute/v2.1/servers/1cc38775-2c7d-4558-8ca9-3a2ef4917949 => generated 1366 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:45:54.764644 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-e1ba13d1-1e2b-4a34-8167-88459e437d82 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:54.765253 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-e1ba13d1-1e2b-4a34-8167-88459e437d82 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:54.771630 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e1ba13d1-1e2b-4a34-8167-88459e437d82 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:54.772409 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e1ba13d1-1e2b-4a34-8167-88459e437d82 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:54.772897 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e1ba13d1-1e2b-4a34-8167-88459e437d82 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:54.773653 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e1ba13d1-1e2b-4a34-8167-88459e437d82 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:54.774182 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e1ba13d1-1e2b-4a34-8167-88459e437d82 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:54.774666 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e1ba13d1-1e2b-4a34-8167-88459e437d82 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:54.821965 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-05d86b2d-4087-41e6-b386-178ad0d9c4fc tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:54.834547 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-05d86b2d-4087-41e6-b386-178ad0d9c4fc tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/61f94aa1-75dc-4f43-aa71-284c50dc394c" status: 200 len: 1577 microversion: 2.1 time: 0.357345 Aug 09 02:45:54.835142 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 346/711] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:45:54 2022] GET /compute/v2.1/servers/61f94aa1-75dc-4f43-aa71-284c50dc394c => generated 1577 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:45:54.951277 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-ba1bc6dd-ad1a-4360-8d53-03f25f883579 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:54.951881 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-ba1bc6dd-ad1a-4360-8d53-03f25f883579 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:54.958142 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ba1bc6dd-ad1a-4360-8d53-03f25f883579 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:54.958660 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ba1bc6dd-ad1a-4360-8d53-03f25f883579 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:54.959093 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ba1bc6dd-ad1a-4360-8d53-03f25f883579 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:54.960471 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ba1bc6dd-ad1a-4360-8d53-03f25f883579 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:54.960928 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ba1bc6dd-ad1a-4360-8d53-03f25f883579 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:54.961539 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ba1bc6dd-ad1a-4360-8d53-03f25f883579 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:54.977473 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.wsgi [None req-ba1bc6dd-ad1a-4360-8d53-03f25f883579 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] HTTP exception thrown: Instance 9919dd32-c9e0-42ae-8981-414c2e663e73 could not be found. Aug 09 02:45:54.979411 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-ba1bc6dd-ad1a-4360-8d53-03f25f883579 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Request method failure captured: Aug 09 02:45:54.979411 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: request: GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 HTTP/1.1 Aug 09 02:45:54.979411 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Accept: application/json Aug 09 02:45:54.979411 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Accept-Encoding: identity Aug 09 02:45:54.979411 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Connection: close Aug 09 02:45:54.979411 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Content-Length: 0 Aug 09 02:45:54.979411 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Content-Type: application/json Aug 09 02:45:54.979411 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Host: 10.222.0.20 Aug 09 02:45:54.979411 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Openstack-System-Scope: None Aug 09 02:45:54.979411 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: User-Agent: python-urllib3/1.26.11 Aug 09 02:45:54.979411 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Auth-Token: gAAAAABi8cl7VgtcdjqsQual3MD2n3KDeY2pZDvdEFD-XPiqcIb6Stef9SKYhMK8dK6AGBzSLHh26_dFHM84KfJw3HBg6ihOE4BQBRRVkGIEwE_TX8a64dEtvPhI7kLhEdt2_PmyuhNl8FCMcrnIQpXxk41_FkyvCMQZmHwG5i5erC5vonxRS6o Aug 09 02:45:54.979411 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Domain-Id: None Aug 09 02:45:54.979411 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Domain-Name: None Aug 09 02:45:54.979411 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Identity-Status: Confirmed Aug 09 02:45:54.979411 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Is-Admin-Project: True Aug 09 02:45:54.979411 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 02:45:54.979411 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Domain-Id: default Aug 09 02:45:54.979411 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Domain-Name: Default Aug 09 02:45:54.979411 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Id: ca6695b7eb3b40ecb4d46292a95e6122 Aug 09 02:45:54.979411 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1993749218 Aug 09 02:45:54.979411 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Role: reader,member Aug 09 02:45:54.979411 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Roles: reader,member Aug 09 02:45:54.981104 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ca6695b7eb3b40ecb4d46292a95e6122"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ca6695b7eb3b40ecb4d46292a95e6122"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ca6695b7eb3b40ecb4d46292a95e6122"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ca6695b7eb3b40ecb4d46292a95e6122"}]}] Aug 09 02:45:54.981104 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1993749218 Aug 09 02:45:54.981104 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant-Id: ca6695b7eb3b40ecb4d46292a95e6122 Aug 09 02:45:54.981104 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1993749218 Aug 09 02:45:54.981104 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User: tempest-AttachVolumeShelveTestJSON-1993749218-project Aug 09 02:45:54.981104 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Domain-Id: default Aug 09 02:45:54.981104 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Domain-Name: Default Aug 09 02:45:54.981104 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Id: 81447e83a97b4519ac6d0eac9a06bdef Aug 09 02:45:54.981104 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1993749218-project Aug 09 02:45:54.981104 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: method: > Aug 09 02:45:54.981104 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: exception: Instance 9919dd32-c9e0-42ae-8981-414c2e663e73 could not be found. Aug 09 02:45:54.981104 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: action_args: {'id': '9919dd32-c9e0-42ae-8981-414c2e663e73'} Aug 09 02:45:54.982022 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 02:45:54.982022 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:45:54.982022 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 02:45:54.982022 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 02:45:54.982022 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 02:45:54.982022 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 02:45:54.982022 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 02:45:54.982022 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 02:45:54.982022 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 02:45:54.982022 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 02:45:54.982022 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9919dd32-c9e0-42ae-8981-414c2e663e73 could not be found. Aug 09 02:45:54.982022 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:45:54.982022 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:45:54.982022 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:45:54.982022 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:45:54.982022 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:45:54.982022 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:45:54.982022 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 02:45:54.982022 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 02:45:54.982022 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 02:45:54.983374 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 02:45:54.983374 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 02:45:54.983374 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 02:45:54.983374 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 02:45:54.983374 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 02:45:54.983374 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 02:45:54.983374 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 02:45:54.983374 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9919dd32-c9e0-42ae-8981-414c2e663e73 could not be found. Aug 09 02:45:54.983374 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:45:54.983374 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:45:54.983374 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:45:54.983374 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:45:54.983374 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:45:54.983374 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:45:54.983374 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 02:45:54.983374 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 02:45:54.983374 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9919dd32-c9e0-42ae-8981-414c2e663e73 could not be found. Aug 09 02:45:54.983374 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:45:54.985825 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-ba1bc6dd-ad1a-4360-8d53-03f25f883579 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Returning 404 to user: Instance 9919dd32-c9e0-42ae-8981-414c2e663e73 could not be found. {{(pid=124425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 02:45:54.987070 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-ba1bc6dd-ad1a-4360-8d53-03f25f883579 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 404 len: 111 microversion: 2.20 time: 0.039861 Aug 09 02:45:54.987962 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 347/712] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:45:54 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 02:45:54.992232 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-e1ba13d1-1e2b-4a34-8167-88459e437d82 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:54.997017 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-1f47f50f-9213-4854-9dd2-07aa043f7eb5 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '.version_select at 0x7fb0a0353b80>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:55.000436 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-e1ba13d1-1e2b-4a34-8167-88459e437d82 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507" status: 200 len: 1507 microversion: 2.1 time: 0.240242 Aug 09 02:45:55.001548 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 366/713] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:45:54 2022] GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507 => generated 1507 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:45:55.029561 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-1f47f50f-9213-4854-9dd2-07aa043f7eb5 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1330101049" status: 204 len: 0 microversion: 2.20 time: 0.037122 Aug 09 02:45:55.034026 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 348/714] 10.222.0.20 () {60 vars in 1262 bytes} [Tue Aug 9 02:45:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1330101049 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 09 02:45:55.228531 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [req-9ffaa155-2c77-4710-baee-10142a1fe9fc req-52dc1a13-1b82-4920-a6a1-cf25be4883de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4571cba1-e225-40c3-aa20-12c3802c6507", "name": "network-vif-deleted", "tag": "8f9897d0-4b5a-4a41-9c95-c0710478bbe7"}]} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:45:55.247886 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-9ffaa155-2c77-4710-baee-10142a1fe9fc req-52dc1a13-1b82-4920-a6a1-cf25be4883de service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:55.248487 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-9ffaa155-2c77-4710-baee-10142a1fe9fc req-52dc1a13-1b82-4920-a6a1-cf25be4883de service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:55.249134 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-9ffaa155-2c77-4710-baee-10142a1fe9fc req-52dc1a13-1b82-4920-a6a1-cf25be4883de service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:55.263198 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.compute.server_external_events [req-9ffaa155-2c77-4710-baee-10142a1fe9fc req-52dc1a13-1b82-4920-a6a1-cf25be4883de service nova] Creating event network-vif-deleted:8f9897d0-4b5a-4a41-9c95-c0710478bbe7 for instance 4571cba1-e225-40c3-aa20-12c3802c6507 on hv-cinder-85246 Aug 09 02:45:55.268782 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [req-9ffaa155-2c77-4710-baee-10142a1fe9fc req-52dc1a13-1b82-4920-a6a1-cf25be4883de service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043982 Aug 09 02:45:55.273620 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 367/715] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:45:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:45:55.772058 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-8fbc366b-a1f4-42b4-97f8-7a237c306310 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:55.773753 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-8fbc366b-a1f4-42b4-97f8-7a237c306310 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 1cc38775-2c7d-4558-8ca9-3a2ef4917949] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:55.781619 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8fbc366b-a1f4-42b4-97f8-7a237c306310 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:55.782201 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8fbc366b-a1f4-42b4-97f8-7a237c306310 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:55.782810 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8fbc366b-a1f4-42b4-97f8-7a237c306310 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:55.784031 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8fbc366b-a1f4-42b4-97f8-7a237c306310 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:55.784534 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8fbc366b-a1f4-42b4-97f8-7a237c306310 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:55.795997 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8fbc366b-a1f4-42b4-97f8-7a237c306310 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:55.861322 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-11543b3a-ff58-470a-a545-c10923452ad1 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:55.862839 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-11543b3a-ff58-470a-a545-c10923452ad1 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 61f94aa1-75dc-4f43-aa71-284c50dc394c] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:55.874482 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-11543b3a-ff58-470a-a545-c10923452ad1 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:55.875541 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-11543b3a-ff58-470a-a545-c10923452ad1 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:55.876262 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-11543b3a-ff58-470a-a545-c10923452ad1 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:55.877976 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-11543b3a-ff58-470a-a545-c10923452ad1 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:55.878880 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-11543b3a-ff58-470a-a545-c10923452ad1 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:55.880704 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-11543b3a-ff58-470a-a545-c10923452ad1 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:55.968143 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-11543b3a-ff58-470a-a545-c10923452ad1 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:55.976484 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-11543b3a-ff58-470a-a545-c10923452ad1 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/61f94aa1-75dc-4f43-aa71-284c50dc394c" status: 200 len: 1509 microversion: 2.1 time: 0.123832 Aug 09 02:45:55.977230 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 368/716] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:45:55 2022] GET /compute/v2.1/servers/61f94aa1-75dc-4f43-aa71-284c50dc394c => generated 1509 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:45:55.995588 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-8fbc366b-a1f4-42b4-97f8-7a237c306310 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:56.004076 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-8fbc366b-a1f4-42b4-97f8-7a237c306310 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/1cc38775-2c7d-4558-8ca9-3a2ef4917949" status: 200 len: 1366 microversion: 2.1 time: 0.236719 Aug 09 02:45:56.005284 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 349/717] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:45:55 2022] GET /compute/v2.1/servers/1cc38775-2c7d-4558-8ca9-3a2ef4917949 => generated 1366 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:45:56.024363 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-93474c8c-ec36-42a6-8224-c82a9543749a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:56.025006 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-93474c8c-ec36-42a6-8224-c82a9543749a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:56.030955 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-93474c8c-ec36-42a6-8224-c82a9543749a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:56.031437 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-93474c8c-ec36-42a6-8224-c82a9543749a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:56.031871 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-93474c8c-ec36-42a6-8224-c82a9543749a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:56.032557 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-93474c8c-ec36-42a6-8224-c82a9543749a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:56.033013 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-93474c8c-ec36-42a6-8224-c82a9543749a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:56.033436 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-93474c8c-ec36-42a6-8224-c82a9543749a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:56.064322 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-93474c8c-ec36-42a6-8224-c82a9543749a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:56.064796 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-93474c8c-ec36-42a6-8224-c82a9543749a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:56.065310 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-93474c8c-ec36-42a6-8224-c82a9543749a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:56.065750 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.objects.instance [None req-93474c8c-ec36-42a6-8224-c82a9543749a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lazy-loading 'fault' on Instance uuid 4571cba1-e225-40c3-aa20-12c3802c6507 {{(pid=124427) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 02:45:56.109029 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-93474c8c-ec36-42a6-8224-c82a9543749a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:56.118345 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-93474c8c-ec36-42a6-8224-c82a9543749a tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507" status: 200 len: 1311 microversion: 2.1 time: 0.097646 Aug 09 02:45:56.119384 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 369/718] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:45:56 2022] GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507 => generated 1311 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:45:56.246258 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [req-5e52eaaa-abfd-4c31-ae94-cc4fb8397b17 req-82072550-c3bf-408b-aac5-6d271d57c575 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61f94aa1-75dc-4f43-aa71-284c50dc394c", "name": "network-vif-deleted", "tag": "02b344f5-9ec1-4ff5-8e96-c217038c81a6"}]} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:45:56.257193 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-5e52eaaa-abfd-4c31-ae94-cc4fb8397b17 req-82072550-c3bf-408b-aac5-6d271d57c575 service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:56.257948 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-5e52eaaa-abfd-4c31-ae94-cc4fb8397b17 req-82072550-c3bf-408b-aac5-6d271d57c575 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:56.258651 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-5e52eaaa-abfd-4c31-ae94-cc4fb8397b17 req-82072550-c3bf-408b-aac5-6d271d57c575 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:56.271930 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.compute.server_external_events [req-5e52eaaa-abfd-4c31-ae94-cc4fb8397b17 req-82072550-c3bf-408b-aac5-6d271d57c575 service nova] Creating event network-vif-deleted:02b344f5-9ec1-4ff5-8e96-c217038c81a6 for instance 61f94aa1-75dc-4f43-aa71-284c50dc394c on hv-cinder-85246 Aug 09 02:45:56.277237 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [req-5e52eaaa-abfd-4c31-ae94-cc4fb8397b17 req-82072550-c3bf-408b-aac5-6d271d57c575 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107420 Aug 09 02:45:56.277946 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 350/719] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:45:56.320373 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-2a3caac5-37ba-474d-bc38-d2e85626f12f tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Action: 'create', calling method: .version_select at 0x7fb0a028aca0>, body: {"keypair": {"name": "tempest-keypair-222512131", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1VMBWHNziCQkSEEA/DKyC9oiSyBx703nitRJ4JRVhIkSJdX5MFTxY5aPfGWmP3S8hRRfbeJu13O+Lq4zIcGiiOqiJN2q0+3qjBwJf+U+cgrqW8G2B+ByiaxVjl95UI2w=="}} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:45:56.335562 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.quota [None req-2a3caac5-37ba-474d-bc38-d2e85626f12f tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Getting quotas for project ca6695b7eb3b40ecb4d46292a95e6122. Resources: {'key_pairs'} {{(pid=124427) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 02:45:56.339392 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.quota [None req-2a3caac5-37ba-474d-bc38-d2e85626f12f tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Getting quotas for user 81447e83a97b4519ac6d0eac9a06bdef and project ca6695b7eb3b40ecb4d46292a95e6122. Resources: {'key_pairs'} {{(pid=124427) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 02:45:56.362880 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-2a3caac5-37ba-474d-bc38-d2e85626f12f tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.046349 Aug 09 02:45:56.363925 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 370/720] 10.222.0.20 () {62 vars in 1200 bytes} [Tue Aug 9 02:45:56 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 48 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 09 02:45:57.000137 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-682dd264-c220-4a8f-acff-bc800a40c2ec tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:57.000993 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-682dd264-c220-4a8f-acff-bc800a40c2ec tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 61f94aa1-75dc-4f43-aa71-284c50dc394c] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:57.023650 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-682dd264-c220-4a8f-acff-bc800a40c2ec tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:57.024649 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-682dd264-c220-4a8f-acff-bc800a40c2ec tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:57.025481 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-682dd264-c220-4a8f-acff-bc800a40c2ec tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:57.025690 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-fd9327ea-1dfc-4364-9fa9-6ce896a05376 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:57.027368 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-682dd264-c220-4a8f-acff-bc800a40c2ec tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:57.027862 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-682dd264-c220-4a8f-acff-bc800a40c2ec tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:57.028471 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-682dd264-c220-4a8f-acff-bc800a40c2ec tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:57.028595 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-fd9327ea-1dfc-4364-9fa9-6ce896a05376 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 1cc38775-2c7d-4558-8ca9-3a2ef4917949] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:57.036386 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-fd9327ea-1dfc-4364-9fa9-6ce896a05376 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:57.037072 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-fd9327ea-1dfc-4364-9fa9-6ce896a05376 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:57.037506 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-fd9327ea-1dfc-4364-9fa9-6ce896a05376 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:57.038239 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-fd9327ea-1dfc-4364-9fa9-6ce896a05376 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:57.038724 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-fd9327ea-1dfc-4364-9fa9-6ce896a05376 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:57.039107 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-fd9327ea-1dfc-4364-9fa9-6ce896a05376 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:57.178655 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-682dd264-c220-4a8f-acff-bc800a40c2ec tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:57.196986 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-682dd264-c220-4a8f-acff-bc800a40c2ec tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/61f94aa1-75dc-4f43-aa71-284c50dc394c" status: 200 len: 1224 microversion: 2.1 time: 0.201161 Aug 09 02:45:57.210233 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 351/721] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:45:56 2022] GET /compute/v2.1/servers/61f94aa1-75dc-4f43-aa71-284c50dc394c => generated 1224 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:45:57.215581 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-2be7d8b4-102e-410a-b8c2-71d8936b78f1 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:57.216442 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-2be7d8b4-102e-410a-b8c2-71d8936b78f1 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: 4571cba1-e225-40c3-aa20-12c3802c6507] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:57.223393 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2be7d8b4-102e-410a-b8c2-71d8936b78f1 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:57.223887 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2be7d8b4-102e-410a-b8c2-71d8936b78f1 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:57.224324 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2be7d8b4-102e-410a-b8c2-71d8936b78f1 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:57.225881 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2be7d8b4-102e-410a-b8c2-71d8936b78f1 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:57.226573 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2be7d8b4-102e-410a-b8c2-71d8936b78f1 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:57.227057 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2be7d8b4-102e-410a-b8c2-71d8936b78f1 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:57.258339 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.wsgi [None req-2be7d8b4-102e-410a-b8c2-71d8936b78f1 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] HTTP exception thrown: Instance 4571cba1-e225-40c3-aa20-12c3802c6507 could not be found. Aug 09 02:45:57.260041 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-2be7d8b4-102e-410a-b8c2-71d8936b78f1 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Request method failure captured: Aug 09 02:45:57.260041 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: request: GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507 HTTP/1.1 Aug 09 02:45:57.260041 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Accept: application/json Aug 09 02:45:57.260041 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Accept-Encoding: identity Aug 09 02:45:57.260041 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Connection: close Aug 09 02:45:57.260041 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Content-Length: 0 Aug 09 02:45:57.260041 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Content-Type: application/json Aug 09 02:45:57.260041 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Host: 10.222.0.20 Aug 09 02:45:57.260041 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Openstack-System-Scope: None Aug 09 02:45:57.260041 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: User-Agent: python-urllib3/1.26.11 Aug 09 02:45:57.260041 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Auth-Token: gAAAAABi8ck0CktcbMqTyHyXW8raM7iadadJrEMEsJe1QuxYKiBhpTouij9hVxYkaHqXy09_JT1eLz1wDM3rcA0s4PsRbPJ5NcIAOnut9F1rfjVmZ0ZLJHay53lPPXa7QLsuxiazoAiezHqBT1Xd8Rz6-J34U6-EpZWhwazb9UjXN8mMBEdn5c0 Aug 09 02:45:57.260041 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Domain-Id: None Aug 09 02:45:57.260041 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Domain-Name: None Aug 09 02:45:57.260041 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Identity-Status: Confirmed Aug 09 02:45:57.260041 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Is-Admin-Project: True Aug 09 02:45:57.260041 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Domain-Id: default Aug 09 02:45:57.260041 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Domain-Name: Default Aug 09 02:45:57.260041 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Id: 65aab6ab3ce94cbd93916edf9c3eedc0 Aug 09 02:45:57.260041 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-806361088 Aug 09 02:45:57.260041 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Role: reader,member Aug 09 02:45:57.260041 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Roles: reader,member Aug 09 02:45:57.261369 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/65aab6ab3ce94cbd93916edf9c3eedc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/65aab6ab3ce94cbd93916edf9c3eedc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_65aab6ab3ce94cbd93916edf9c3eedc0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/65aab6ab3ce94cbd93916edf9c3eedc0"}]}] Aug 09 02:45:57.261369 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant: tempest-ServerRescueNegativeTestJSON-806361088 Aug 09 02:45:57.261369 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant-Id: 65aab6ab3ce94cbd93916edf9c3eedc0 Aug 09 02:45:57.261369 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-806361088 Aug 09 02:45:57.261369 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User: tempest-ServerRescueNegativeTestJSON-806361088-project Aug 09 02:45:57.261369 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Domain-Id: default Aug 09 02:45:57.261369 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Domain-Name: Default Aug 09 02:45:57.261369 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Id: 192a8abd4c7a4535a42bea7648535dc3 Aug 09 02:45:57.261369 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Name: tempest-ServerRescueNegativeTestJSON-806361088-project Aug 09 02:45:57.261369 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: method: > Aug 09 02:45:57.261369 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: exception: Instance 4571cba1-e225-40c3-aa20-12c3802c6507 could not be found. Aug 09 02:45:57.261369 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: action_args: {'id': '4571cba1-e225-40c3-aa20-12c3802c6507'} Aug 09 02:45:57.262651 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 02:45:57.262651 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:45:57.262651 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 02:45:57.262651 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 02:45:57.262651 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 02:45:57.262651 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 02:45:57.262651 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 02:45:57.262651 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 02:45:57.262651 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 02:45:57.262651 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 02:45:57.262651 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4571cba1-e225-40c3-aa20-12c3802c6507 could not be found. Aug 09 02:45:57.262651 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:45:57.262651 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:45:57.262651 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:45:57.262651 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:45:57.262651 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:45:57.262651 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:45:57.262651 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 02:45:57.262651 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 02:45:57.262651 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 02:45:57.263895 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 02:45:57.263895 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 02:45:57.263895 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 02:45:57.263895 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 02:45:57.263895 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 02:45:57.263895 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 02:45:57.263895 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 02:45:57.263895 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4571cba1-e225-40c3-aa20-12c3802c6507 could not be found. Aug 09 02:45:57.263895 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:45:57.263895 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:45:57.263895 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:45:57.263895 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:45:57.263895 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:45:57.263895 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:45:57.263895 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 02:45:57.263895 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 02:45:57.263895 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4571cba1-e225-40c3-aa20-12c3802c6507 could not be found. Aug 09 02:45:57.263895 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:45:57.264951 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-2be7d8b4-102e-410a-b8c2-71d8936b78f1 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Returning 404 to user: Instance 4571cba1-e225-40c3-aa20-12c3802c6507 could not be found. {{(pid=124425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 02:45:57.264951 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-2be7d8b4-102e-410a-b8c2-71d8936b78f1 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507" status: 404 len: 111 microversion: 2.1 time: 0.059051 Aug 09 02:45:57.264951 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 352/722] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:45:57 2022] GET /compute/v2.1/servers/4571cba1-e225-40c3-aa20-12c3802c6507 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 02:45:57.270711 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-68419943-8e2c-4844-bc85-2b8aec9daf58 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:57.271147 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-68419943-8e2c-4844-bc85-2b8aec9daf58 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: a587f99c-5ad7-4fa2-945e-06954d45d44d] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:57.278600 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-68419943-8e2c-4844-bc85-2b8aec9daf58 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:57.279088 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-68419943-8e2c-4844-bc85-2b8aec9daf58 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:57.279522 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-68419943-8e2c-4844-bc85-2b8aec9daf58 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:57.280377 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-68419943-8e2c-4844-bc85-2b8aec9daf58 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:57.280845 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-68419943-8e2c-4844-bc85-2b8aec9daf58 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:57.281276 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-68419943-8e2c-4844-bc85-2b8aec9daf58 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:57.298309 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-fd9327ea-1dfc-4364-9fa9-6ce896a05376 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:57.307199 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-fd9327ea-1dfc-4364-9fa9-6ce896a05376 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/1cc38775-2c7d-4558-8ca9-3a2ef4917949" status: 200 len: 1557 microversion: 2.1 time: 0.286171 Aug 09 02:45:57.308348 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 371/723] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:45:57 2022] GET /compute/v2.1/servers/1cc38775-2c7d-4558-8ca9-3a2ef4917949 => generated 1557 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:45:57.321658 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-68419943-8e2c-4844-bc85-2b8aec9daf58 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: a587f99c-5ad7-4fa2-945e-06954d45d44d] Going to try to terminate instance {{(pid=124425) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 02:45:57.327863 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-5bfb9a22-e537-451c-983e-214d2b907bec tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:57.329217 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-5bfb9a22-e537-451c-983e-214d2b907bec tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 1cc38775-2c7d-4558-8ca9-3a2ef4917949] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:57.336384 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5bfb9a22-e537-451c-983e-214d2b907bec tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:57.336927 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5bfb9a22-e537-451c-983e-214d2b907bec tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:57.337357 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5bfb9a22-e537-451c-983e-214d2b907bec tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:57.338198 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5bfb9a22-e537-451c-983e-214d2b907bec tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:57.338663 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5bfb9a22-e537-451c-983e-214d2b907bec tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:57.339083 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5bfb9a22-e537-451c-983e-214d2b907bec tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:57.408797 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-68419943-8e2c-4844-bc85-2b8aec9daf58 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d" status: 204 len: 0 microversion: 2.1 time: 0.141890 Aug 09 02:45:57.409814 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 353/724] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 9 02:45:57 2022] DELETE /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 02:45:57.418887 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-229ceeb3-cdd7-4ba4-8869-77a0fa512814 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:57.419611 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-229ceeb3-cdd7-4ba4-8869-77a0fa512814 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: a587f99c-5ad7-4fa2-945e-06954d45d44d] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:57.425818 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-229ceeb3-cdd7-4ba4-8869-77a0fa512814 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:57.426464 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-229ceeb3-cdd7-4ba4-8869-77a0fa512814 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:57.426914 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-229ceeb3-cdd7-4ba4-8869-77a0fa512814 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:57.427609 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-229ceeb3-cdd7-4ba4-8869-77a0fa512814 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:57.428058 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-229ceeb3-cdd7-4ba4-8869-77a0fa512814 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:57.428475 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-229ceeb3-cdd7-4ba4-8869-77a0fa512814 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:57.487700 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-5bfb9a22-e537-451c-983e-214d2b907bec tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/1cc38775-2c7d-4558-8ca9-3a2ef4917949/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.163979 Aug 09 02:45:57.495648 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 372/725] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Aug 9 02:45:57 2022] GET /compute/v2.1/servers/1cc38775-2c7d-4558-8ca9-3a2ef4917949/os-interface => generated 285 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 02:45:57.913831 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-229ceeb3-cdd7-4ba4-8869-77a0fa512814 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:57.921725 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-229ceeb3-cdd7-4ba4-8869-77a0fa512814 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d" status: 200 len: 1521 microversion: 2.1 time: 0.507155 Aug 09 02:45:57.922337 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 354/726] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:45:57 2022] GET /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d => generated 1521 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:45:58.218700 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-c99d3698-1bd5-4397-bf19-9a47c7b2158b tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:58.219259 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-c99d3698-1bd5-4397-bf19-9a47c7b2158b tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 61f94aa1-75dc-4f43-aa71-284c50dc394c] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:58.226067 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-c99d3698-1bd5-4397-bf19-9a47c7b2158b tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:58.226578 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-c99d3698-1bd5-4397-bf19-9a47c7b2158b tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:58.227001 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-c99d3698-1bd5-4397-bf19-9a47c7b2158b tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:58.227699 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-c99d3698-1bd5-4397-bf19-9a47c7b2158b tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:58.228138 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-c99d3698-1bd5-4397-bf19-9a47c7b2158b tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:58.228557 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-c99d3698-1bd5-4397-bf19-9a47c7b2158b tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:58.261983 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-c99d3698-1bd5-4397-bf19-9a47c7b2158b tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:58.262486 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-c99d3698-1bd5-4397-bf19-9a47c7b2158b tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:58.262907 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-c99d3698-1bd5-4397-bf19-9a47c7b2158b tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:58.263313 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.objects.instance [None req-c99d3698-1bd5-4397-bf19-9a47c7b2158b tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lazy-loading 'fault' on Instance uuid 61f94aa1-75dc-4f43-aa71-284c50dc394c {{(pid=124427) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 02:45:58.385937 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-c99d3698-1bd5-4397-bf19-9a47c7b2158b tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:58.393952 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-c99d3698-1bd5-4397-bf19-9a47c7b2158b tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/61f94aa1-75dc-4f43-aa71-284c50dc394c" status: 200 len: 1229 microversion: 2.1 time: 0.179827 Aug 09 02:45:58.394771 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 373/727] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:45:58 2022] GET /compute/v2.1/servers/61f94aa1-75dc-4f43-aa71-284c50dc394c => generated 1229 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:45:58.672149 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-46ff2ce4-d756-47ec-85d0-4a321299424d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-430828279", "imageRef": "04a06944-b2a8-4a65-b2a6-7ed3ff18a627", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0f4ed732-540e-4797-ab30-71de6f473add"}], "security_groups": [{"name": "tempest-securitygroup--1852176199"}], "key_name": "tempest-keypair-222512131", "user_data": "}} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:45:58.796278 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.network.neutron [None req-46ff2ce4-d756-47ec-85d0-4a321299424d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] validate_networks() for [('0f4ed732-540e-4797-ab30-71de6f473add', None, None, None, None, None)] {{(pid=124425) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 02:45:58.943011 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-e7fe51ea-e3a2-4dcf-8bca-61642deec1be tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:58.943622 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-e7fe51ea-e3a2-4dcf-8bca-61642deec1be tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: a587f99c-5ad7-4fa2-945e-06954d45d44d] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:58.949869 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e7fe51ea-e3a2-4dcf-8bca-61642deec1be tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:58.950363 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e7fe51ea-e3a2-4dcf-8bca-61642deec1be tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:58.950828 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e7fe51ea-e3a2-4dcf-8bca-61642deec1be tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:58.951517 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e7fe51ea-e3a2-4dcf-8bca-61642deec1be tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:58.951997 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e7fe51ea-e3a2-4dcf-8bca-61642deec1be tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:58.952417 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e7fe51ea-e3a2-4dcf-8bca-61642deec1be tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:59.245471 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-e7fe51ea-e3a2-4dcf-8bca-61642deec1be tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:59.254889 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-e7fe51ea-e3a2-4dcf-8bca-61642deec1be tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d" status: 200 len: 1521 microversion: 2.1 time: 0.315391 Aug 09 02:45:59.255005 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 374/728] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:45:58 2022] GET /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d => generated 1521 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:45:59.315211 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [req-b26ef577-ee47-4400-8674-a789b1dc15e0 req-b9995b27-93dd-431c-8c89-fed1db950175 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cc38775-2c7d-4558-8ca9-3a2ef4917949", "tag": "788bd99b-2ce6-4f25-9014-bd68dbaaa698"}]} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:45:59.326487 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-b26ef577-ee47-4400-8674-a789b1dc15e0 req-b9995b27-93dd-431c-8c89-fed1db950175 service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:59.326961 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-b26ef577-ee47-4400-8674-a789b1dc15e0 req-b9995b27-93dd-431c-8c89-fed1db950175 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:59.327391 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-b26ef577-ee47-4400-8674-a789b1dc15e0 req-b9995b27-93dd-431c-8c89-fed1db950175 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:59.339120 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.compute.server_external_events [req-b26ef577-ee47-4400-8674-a789b1dc15e0 req-b9995b27-93dd-431c-8c89-fed1db950175 service nova] Creating event network-changed:788bd99b-2ce6-4f25-9014-bd68dbaaa698 for instance 1cc38775-2c7d-4558-8ca9-3a2ef4917949 on hv-cinder-85246 Aug 09 02:45:59.344055 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [req-b26ef577-ee47-4400-8674-a789b1dc15e0 req-b9995b27-93dd-431c-8c89-fed1db950175 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032682 Aug 09 02:45:59.344842 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 375/729] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:45:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:45:59.422453 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-d91a93f1-76d0-4ac6-8b32-3f661e3e829b tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:59.423154 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-d91a93f1-76d0-4ac6-8b32-3f661e3e829b tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 61f94aa1-75dc-4f43-aa71-284c50dc394c] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:59.424596 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.virt.hardware [None req-46ff2ce4-d756-47ec-85d0-4a321299424d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Flavor limits 0:0:0 {{(pid=124425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 02:45:59.425019 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.virt.hardware [None req-46ff2ce4-d756-47ec-85d0-4a321299424d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Image limits 0:0:0 {{(pid=124425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 02:45:59.425484 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.virt.hardware [None req-46ff2ce4-d756-47ec-85d0-4a321299424d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Flavor pref 0:0:0 {{(pid=124425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 02:45:59.425886 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.virt.hardware [None req-46ff2ce4-d756-47ec-85d0-4a321299424d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Image pref 0:0:0 {{(pid=124425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 02:45:59.426622 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.virt.hardware [None req-46ff2ce4-d756-47ec-85d0-4a321299424d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 02:45:59.432771 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d91a93f1-76d0-4ac6-8b32-3f661e3e829b tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:59.433250 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d91a93f1-76d0-4ac6-8b32-3f661e3e829b tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:59.433887 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d91a93f1-76d0-4ac6-8b32-3f661e3e829b tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:59.434635 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d91a93f1-76d0-4ac6-8b32-3f661e3e829b tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:59.435076 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d91a93f1-76d0-4ac6-8b32-3f661e3e829b tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:59.435435 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-46ff2ce4-d756-47ec-85d0-4a321299424d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:59.435549 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d91a93f1-76d0-4ac6-8b32-3f661e3e829b tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:59.435913 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-46ff2ce4-d756-47ec-85d0-4a321299424d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:59.436340 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-46ff2ce4-d756-47ec-85d0-4a321299424d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:59.437057 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-46ff2ce4-d756-47ec-85d0-4a321299424d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:59.437500 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-46ff2ce4-d756-47ec-85d0-4a321299424d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:59.437916 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-46ff2ce4-d756-47ec-85d0-4a321299424d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:59.455235 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.quota [None req-46ff2ce4-d756-47ec-85d0-4a321299424d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Getting quotas for project ca6695b7eb3b40ecb4d46292a95e6122. Resources: {'cores', 'ram', 'instances'} {{(pid=124425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 02:45:59.459278 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.quota [None req-46ff2ce4-d756-47ec-85d0-4a321299424d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Getting quotas for user 81447e83a97b4519ac6d0eac9a06bdef and project ca6695b7eb3b40ecb4d46292a95e6122. Resources: {'cores', 'ram', 'instances'} {{(pid=124425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 02:45:59.466370 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d91a93f1-76d0-4ac6-8b32-3f661e3e829b tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:45:59.467047 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d91a93f1-76d0-4ac6-8b32-3f661e3e829b tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:45:59.467663 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d91a93f1-76d0-4ac6-8b32-3f661e3e829b tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:45:59.468104 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.objects.instance [None req-d91a93f1-76d0-4ac6-8b32-3f661e3e829b tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lazy-loading 'fault' on Instance uuid 61f94aa1-75dc-4f43-aa71-284c50dc394c {{(pid=124427) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 02:45:59.472508 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-46ff2ce4-d756-47ec-85d0-4a321299424d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Going to run 1 instances... {{(pid=124425) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 02:45:59.474910 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-46ff2ce4-d756-47ec-85d0-4a321299424d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='04a06944-b2a8-4a65-b2a6-7ed3ff18a627',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 02:45:59.510875 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-d91a93f1-76d0-4ac6-8b32-3f661e3e829b tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:59.518586 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-d91a93f1-76d0-4ac6-8b32-3f661e3e829b tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/61f94aa1-75dc-4f43-aa71-284c50dc394c" status: 200 len: 1229 microversion: 2.1 time: 0.104952 Aug 09 02:45:59.519149 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 376/730] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:45:59 2022] GET /compute/v2.1/servers/61f94aa1-75dc-4f43-aa71-284c50dc394c => generated 1229 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:45:59.525629 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-46ff2ce4-d756-47ec-85d0-4a321299424d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.858193 Aug 09 02:45:59.532084 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 355/731] 10.222.0.20 () {62 vars in 1188 bytes} [Tue Aug 9 02:45:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 865 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 09 02:45:59.537451 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-95d3c811-909d-4fcf-8969-ac7b6319004c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:45:59.538088 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-95d3c811-909d-4fcf-8969-ac7b6319004c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:45:59.590918 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-95d3c811-909d-4fcf-8969-ac7b6319004c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:59.598325 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-95d3c811-909d-4fcf-8969-ac7b6319004c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:59.599805 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-95d3c811-909d-4fcf-8969-ac7b6319004c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:45:59.600905 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-95d3c811-909d-4fcf-8969-ac7b6319004c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 200 len: 1280 microversion: 2.20 time: 0.067565 Aug 09 02:45:59.601469 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 377/732] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:45:59 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 1280 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:46:00.276022 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-6792fe13-e8f2-496c-9fbd-bd3802d28d16 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:00.276622 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-6792fe13-e8f2-496c-9fbd-bd3802d28d16 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: a587f99c-5ad7-4fa2-945e-06954d45d44d] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:00.286019 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6792fe13-e8f2-496c-9fbd-bd3802d28d16 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:00.286552 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6792fe13-e8f2-496c-9fbd-bd3802d28d16 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:00.286999 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6792fe13-e8f2-496c-9fbd-bd3802d28d16 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:00.287683 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6792fe13-e8f2-496c-9fbd-bd3802d28d16 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:00.288133 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6792fe13-e8f2-496c-9fbd-bd3802d28d16 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:00.288557 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6792fe13-e8f2-496c-9fbd-bd3802d28d16 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:00.427578 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-6792fe13-e8f2-496c-9fbd-bd3802d28d16 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:00.436535 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-6792fe13-e8f2-496c-9fbd-bd3802d28d16 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d" status: 200 len: 1521 microversion: 2.1 time: 0.164713 Aug 09 02:46:00.437212 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 356/733] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:00 2022] GET /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:46:00.540302 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-e776aa64-5903-46b8-a9f4-2b495d53537e tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:00.540931 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-e776aa64-5903-46b8-a9f4-2b495d53537e tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 61f94aa1-75dc-4f43-aa71-284c50dc394c] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:00.547709 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e776aa64-5903-46b8-a9f4-2b495d53537e tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:00.548190 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e776aa64-5903-46b8-a9f4-2b495d53537e tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:00.548614 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e776aa64-5903-46b8-a9f4-2b495d53537e tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:00.549311 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e776aa64-5903-46b8-a9f4-2b495d53537e tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:00.549761 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e776aa64-5903-46b8-a9f4-2b495d53537e tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:00.550183 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e776aa64-5903-46b8-a9f4-2b495d53537e tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:00.580952 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e776aa64-5903-46b8-a9f4-2b495d53537e tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:00.581426 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e776aa64-5903-46b8-a9f4-2b495d53537e tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:00.581857 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e776aa64-5903-46b8-a9f4-2b495d53537e tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:00.582353 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.objects.instance [None req-e776aa64-5903-46b8-a9f4-2b495d53537e tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lazy-loading 'fault' on Instance uuid 61f94aa1-75dc-4f43-aa71-284c50dc394c {{(pid=124427) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 02:46:00.623598 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-b9f8a891-cf02-4dba-adec-609bb9fb2804 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:00.624307 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-b9f8a891-cf02-4dba-adec-609bb9fb2804 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:00.626248 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-e776aa64-5903-46b8-a9f4-2b495d53537e tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:00.631725 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b9f8a891-cf02-4dba-adec-609bb9fb2804 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:00.632337 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b9f8a891-cf02-4dba-adec-609bb9fb2804 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:00.633010 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b9f8a891-cf02-4dba-adec-609bb9fb2804 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:00.633950 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b9f8a891-cf02-4dba-adec-609bb9fb2804 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:00.634432 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b9f8a891-cf02-4dba-adec-609bb9fb2804 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:00.634550 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-e776aa64-5903-46b8-a9f4-2b495d53537e tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/61f94aa1-75dc-4f43-aa71-284c50dc394c" status: 200 len: 1229 microversion: 2.1 time: 0.098125 Aug 09 02:46:00.634885 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b9f8a891-cf02-4dba-adec-609bb9fb2804 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:00.635563 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 378/734] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:00 2022] GET /compute/v2.1/servers/61f94aa1-75dc-4f43-aa71-284c50dc394c => generated 1229 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:46:00.710825 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-b9f8a891-cf02-4dba-adec-609bb9fb2804 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:00.719581 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-b9f8a891-cf02-4dba-adec-609bb9fb2804 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:00.721672 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-b9f8a891-cf02-4dba-adec-609bb9fb2804 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:00.723149 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-b9f8a891-cf02-4dba-adec-609bb9fb2804 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 200 len: 1284 microversion: 2.20 time: 0.103729 Aug 09 02:46:00.723972 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 357/735] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:46:00 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 1284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:46:01.429052 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [req-c695eb83-70c9-4c47-9f22-ac73c6760265 req-285973b2-cfd5-43f8-a0dd-a184dbbd8c25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a587f99c-5ad7-4fa2-945e-06954d45d44d", "name": "network-vif-deleted", "tag": "6db685d1-484e-4847-8638-637842940e30"}]} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:46:01.439270 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-c695eb83-70c9-4c47-9f22-ac73c6760265 req-285973b2-cfd5-43f8-a0dd-a184dbbd8c25 service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:01.439746 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-c695eb83-70c9-4c47-9f22-ac73c6760265 req-285973b2-cfd5-43f8-a0dd-a184dbbd8c25 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:01.440208 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-c695eb83-70c9-4c47-9f22-ac73c6760265 req-285973b2-cfd5-43f8-a0dd-a184dbbd8c25 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:01.451741 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.compute.server_external_events [req-c695eb83-70c9-4c47-9f22-ac73c6760265 req-285973b2-cfd5-43f8-a0dd-a184dbbd8c25 service nova] Creating event network-vif-deleted:6db685d1-484e-4847-8638-637842940e30 for instance a587f99c-5ad7-4fa2-945e-06954d45d44d on hv-cinder-85246 Aug 09 02:46:01.457138 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [req-c695eb83-70c9-4c47-9f22-ac73c6760265 req-285973b2-cfd5-43f8-a0dd-a184dbbd8c25 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099917 Aug 09 02:46:01.457870 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 379/736] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:46:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:46:01.459268 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-00437a3f-a8d4-4492-8bf2-a2f1dc204746 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:01.460145 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-00437a3f-a8d4-4492-8bf2-a2f1dc204746 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: a587f99c-5ad7-4fa2-945e-06954d45d44d] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:01.470841 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-00437a3f-a8d4-4492-8bf2-a2f1dc204746 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:01.471385 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-00437a3f-a8d4-4492-8bf2-a2f1dc204746 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:01.471821 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-00437a3f-a8d4-4492-8bf2-a2f1dc204746 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:01.478467 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-00437a3f-a8d4-4492-8bf2-a2f1dc204746 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:01.479219 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-00437a3f-a8d4-4492-8bf2-a2f1dc204746 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:01.479643 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-00437a3f-a8d4-4492-8bf2-a2f1dc204746 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:01.521017 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-00437a3f-a8d4-4492-8bf2-a2f1dc204746 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:01.521400 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-00437a3f-a8d4-4492-8bf2-a2f1dc204746 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:01.522011 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-00437a3f-a8d4-4492-8bf2-a2f1dc204746 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:01.522665 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.objects.instance [None req-00437a3f-a8d4-4492-8bf2-a2f1dc204746 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lazy-loading 'fault' on Instance uuid a587f99c-5ad7-4fa2-945e-06954d45d44d {{(pid=124425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 02:46:01.568819 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-00437a3f-a8d4-4492-8bf2-a2f1dc204746 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192a8abd4c7a4535a42bea7648535dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aab6ab3ce94cbd93916edf9c3eedc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:01.588101 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-00437a3f-a8d4-4492-8bf2-a2f1dc204746 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d" status: 200 len: 1311 microversion: 2.1 time: 0.133084 Aug 09 02:46:01.588681 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 358/737] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:01 2022] GET /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d => generated 1311 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:46:01.658342 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-5a5aa199-3101-451a-b347-58247b24c3d5 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:01.659181 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-5a5aa199-3101-451a-b347-58247b24c3d5 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 61f94aa1-75dc-4f43-aa71-284c50dc394c] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:01.665780 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5a5aa199-3101-451a-b347-58247b24c3d5 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:01.666300 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5a5aa199-3101-451a-b347-58247b24c3d5 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:01.666739 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5a5aa199-3101-451a-b347-58247b24c3d5 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:01.667449 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5a5aa199-3101-451a-b347-58247b24c3d5 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:01.667895 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5a5aa199-3101-451a-b347-58247b24c3d5 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:01.668728 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5a5aa199-3101-451a-b347-58247b24c3d5 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:01.683391 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.wsgi [None req-5a5aa199-3101-451a-b347-58247b24c3d5 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] HTTP exception thrown: Instance 61f94aa1-75dc-4f43-aa71-284c50dc394c could not be found. Aug 09 02:46:01.685107 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-5a5aa199-3101-451a-b347-58247b24c3d5 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Request method failure captured: Aug 09 02:46:01.685107 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: request: GET /compute/v2.1/servers/61f94aa1-75dc-4f43-aa71-284c50dc394c HTTP/1.1 Aug 09 02:46:01.685107 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Accept: application/json Aug 09 02:46:01.685107 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Accept-Encoding: identity Aug 09 02:46:01.685107 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Connection: close Aug 09 02:46:01.685107 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Content-Length: 0 Aug 09 02:46:01.685107 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Content-Type: application/json Aug 09 02:46:01.685107 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Host: 10.222.0.20 Aug 09 02:46:01.685107 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Openstack-System-Scope: None Aug 09 02:46:01.685107 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: User-Agent: python-urllib3/1.26.11 Aug 09 02:46:01.685107 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Auth-Token: gAAAAABi8cmR_XEASBFZjAVs2tdYwkUdxzYF8jaukiz0_i40mEw8JpEsqOLhjPu0clk-qD9vmP1oTEf4-LR9neo_6zkM9Wy6qiJtcxvv89W5JGUaF5yj24-XvHEG9HkU5wZOUbb8pxncVoJ-L0c8AUP26kM4nuPVsS6zsfalXiIF0K85zBow9x0 Aug 09 02:46:01.685107 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Domain-Id: None Aug 09 02:46:01.685107 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Domain-Name: None Aug 09 02:46:01.685107 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Identity-Status: Confirmed Aug 09 02:46:01.685107 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Is-Admin-Project: True Aug 09 02:46:01.685107 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Domain-Id: default Aug 09 02:46:01.685107 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Domain-Name: Default Aug 09 02:46:01.685107 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Id: 9aadaf242f674436a45eae700fb52fc1 Aug 09 02:46:01.685107 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Name: tempest-TestVolumeBootPattern-1127083574 Aug 09 02:46:01.685107 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Role: reader,member Aug 09 02:46:01.685107 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Roles: reader,member Aug 09 02:46:01.687652 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9aadaf242f674436a45eae700fb52fc1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9aadaf242f674436a45eae700fb52fc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9aadaf242f674436a45eae700fb52fc1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9aadaf242f674436a45eae700fb52fc1"}]}] Aug 09 02:46:01.687652 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant: tempest-TestVolumeBootPattern-1127083574 Aug 09 02:46:01.687652 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant-Id: 9aadaf242f674436a45eae700fb52fc1 Aug 09 02:46:01.687652 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant-Name: tempest-TestVolumeBootPattern-1127083574 Aug 09 02:46:01.687652 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User: tempest-TestVolumeBootPattern-1127083574-project Aug 09 02:46:01.687652 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Domain-Id: default Aug 09 02:46:01.687652 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Domain-Name: Default Aug 09 02:46:01.687652 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Id: 90fa94f90d49485a81d502929bcd0b93 Aug 09 02:46:01.687652 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Name: tempest-TestVolumeBootPattern-1127083574-project Aug 09 02:46:01.687652 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: method: > Aug 09 02:46:01.687652 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: exception: Instance 61f94aa1-75dc-4f43-aa71-284c50dc394c could not be found. Aug 09 02:46:01.687652 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: action_args: {'id': '61f94aa1-75dc-4f43-aa71-284c50dc394c'} Aug 09 02:46:01.689368 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 02:46:01.689368 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:46:01.689368 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 02:46:01.689368 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 02:46:01.689368 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 02:46:01.689368 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 02:46:01.689368 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 02:46:01.689368 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 02:46:01.689368 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 02:46:01.689368 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 02:46:01.689368 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61f94aa1-75dc-4f43-aa71-284c50dc394c could not be found. Aug 09 02:46:01.689368 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:46:01.689368 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:46:01.689368 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:46:01.689368 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:46:01.689368 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:46:01.689368 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:46:01.689368 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 02:46:01.689368 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 02:46:01.689368 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 02:46:01.691936 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 02:46:01.691936 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 02:46:01.691936 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 02:46:01.691936 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 02:46:01.691936 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 02:46:01.691936 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 02:46:01.691936 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 02:46:01.691936 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61f94aa1-75dc-4f43-aa71-284c50dc394c could not be found. Aug 09 02:46:01.691936 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:46:01.691936 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:46:01.691936 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:46:01.691936 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:46:01.691936 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:46:01.691936 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:46:01.691936 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 02:46:01.691936 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 02:46:01.691936 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61f94aa1-75dc-4f43-aa71-284c50dc394c could not be found. Aug 09 02:46:01.691936 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:46:01.693649 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-5a5aa199-3101-451a-b347-58247b24c3d5 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Returning 404 to user: Instance 61f94aa1-75dc-4f43-aa71-284c50dc394c could not be found. {{(pid=124427) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 02:46:01.693649 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-5a5aa199-3101-451a-b347-58247b24c3d5 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/61f94aa1-75dc-4f43-aa71-284c50dc394c" status: 404 len: 111 microversion: 2.1 time: 0.033089 Aug 09 02:46:01.693649 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 380/738] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:01 2022] GET /compute/v2.1/servers/61f94aa1-75dc-4f43-aa71-284c50dc394c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 02:46:01.747082 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-b058875f-1c2b-4e96-a3eb-992600c99d77 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:01.747728 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-b058875f-1c2b-4e96-a3eb-992600c99d77 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:01.754625 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b058875f-1c2b-4e96-a3eb-992600c99d77 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:01.755090 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b058875f-1c2b-4e96-a3eb-992600c99d77 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:01.755738 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b058875f-1c2b-4e96-a3eb-992600c99d77 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:01.756436 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b058875f-1c2b-4e96-a3eb-992600c99d77 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:01.756855 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b058875f-1c2b-4e96-a3eb-992600c99d77 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:01.757299 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b058875f-1c2b-4e96-a3eb-992600c99d77 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:01.789827 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-41c34add-ea0d-4008-8e88-e1983c37e9f3 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1645746637", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-93674777", "security_groups": [{"name": "tempest-secgroup-smoke-1734634472"}], "block_device_mapping_v2": [{"uuid": "95a59f6e-74c4-481f-975c-c9cbff04562e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b1e2d894-011a-4b96-b401-d6a3370e9f10"}]}} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:46:01.831885 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-b058875f-1c2b-4e96-a3eb-992600c99d77 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:01.840373 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-b058875f-1c2b-4e96-a3eb-992600c99d77 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:01.841871 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-b058875f-1c2b-4e96-a3eb-992600c99d77 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:01.843062 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-b058875f-1c2b-4e96-a3eb-992600c99d77 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 200 len: 1338 microversion: 2.20 time: 0.100797 Aug 09 02:46:01.844461 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 359/739] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:46:01 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 1338 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:46:01.955427 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.network.neutron [None req-41c34add-ea0d-4008-8e88-e1983c37e9f3 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] validate_networks() for [('b1e2d894-011a-4b96-b401-d6a3370e9f10', None, None, None, None, None)] {{(pid=124427) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 02:46:02.609476 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-9cce9ec6-d574-40a0-a008-7283d5c3f761 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:02.610084 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-9cce9ec6-d574-40a0-a008-7283d5c3f761 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] [instance: a587f99c-5ad7-4fa2-945e-06954d45d44d] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:02.618610 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9cce9ec6-d574-40a0-a008-7283d5c3f761 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:02.619117 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9cce9ec6-d574-40a0-a008-7283d5c3f761 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:02.619552 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9cce9ec6-d574-40a0-a008-7283d5c3f761 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:02.620268 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9cce9ec6-d574-40a0-a008-7283d5c3f761 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:02.620722 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9cce9ec6-d574-40a0-a008-7283d5c3f761 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:02.621150 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9cce9ec6-d574-40a0-a008-7283d5c3f761 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:02.636446 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.wsgi [None req-9cce9ec6-d574-40a0-a008-7283d5c3f761 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] HTTP exception thrown: Instance a587f99c-5ad7-4fa2-945e-06954d45d44d could not be found. Aug 09 02:46:02.638273 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-9cce9ec6-d574-40a0-a008-7283d5c3f761 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Request method failure captured: Aug 09 02:46:02.638273 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: request: GET /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d HTTP/1.1 Aug 09 02:46:02.638273 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Accept: application/json Aug 09 02:46:02.638273 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Accept-Encoding: identity Aug 09 02:46:02.638273 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Connection: close Aug 09 02:46:02.638273 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Content-Length: 0 Aug 09 02:46:02.638273 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Content-Type: application/json Aug 09 02:46:02.638273 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Host: 10.222.0.20 Aug 09 02:46:02.638273 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Openstack-System-Scope: None Aug 09 02:46:02.638273 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: User-Agent: python-urllib3/1.26.11 Aug 09 02:46:02.638273 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Auth-Token: gAAAAABi8ck0CktcbMqTyHyXW8raM7iadadJrEMEsJe1QuxYKiBhpTouij9hVxYkaHqXy09_JT1eLz1wDM3rcA0s4PsRbPJ5NcIAOnut9F1rfjVmZ0ZLJHay53lPPXa7QLsuxiazoAiezHqBT1Xd8Rz6-J34U6-EpZWhwazb9UjXN8mMBEdn5c0 Aug 09 02:46:02.638273 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Domain-Id: None Aug 09 02:46:02.638273 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Domain-Name: None Aug 09 02:46:02.638273 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Identity-Status: Confirmed Aug 09 02:46:02.638273 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Is-Admin-Project: True Aug 09 02:46:02.638273 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Domain-Id: default Aug 09 02:46:02.638273 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Domain-Name: Default Aug 09 02:46:02.638273 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Id: 65aab6ab3ce94cbd93916edf9c3eedc0 Aug 09 02:46:02.638273 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-806361088 Aug 09 02:46:02.638273 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Role: reader,member Aug 09 02:46:02.638273 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Roles: reader,member Aug 09 02:46:02.639768 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/65aab6ab3ce94cbd93916edf9c3eedc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/65aab6ab3ce94cbd93916edf9c3eedc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_65aab6ab3ce94cbd93916edf9c3eedc0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/65aab6ab3ce94cbd93916edf9c3eedc0"}]}] Aug 09 02:46:02.639768 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant: tempest-ServerRescueNegativeTestJSON-806361088 Aug 09 02:46:02.639768 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant-Id: 65aab6ab3ce94cbd93916edf9c3eedc0 Aug 09 02:46:02.639768 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-806361088 Aug 09 02:46:02.639768 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User: tempest-ServerRescueNegativeTestJSON-806361088-project Aug 09 02:46:02.639768 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Domain-Id: default Aug 09 02:46:02.639768 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Domain-Name: Default Aug 09 02:46:02.639768 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Id: 192a8abd4c7a4535a42bea7648535dc3 Aug 09 02:46:02.639768 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Name: tempest-ServerRescueNegativeTestJSON-806361088-project Aug 09 02:46:02.639768 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: method: > Aug 09 02:46:02.639768 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: exception: Instance a587f99c-5ad7-4fa2-945e-06954d45d44d could not be found. Aug 09 02:46:02.639768 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: action_args: {'id': 'a587f99c-5ad7-4fa2-945e-06954d45d44d'} Aug 09 02:46:02.640608 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 02:46:02.640608 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:46:02.640608 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 02:46:02.640608 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 02:46:02.640608 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 02:46:02.640608 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 02:46:02.640608 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 02:46:02.640608 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 02:46:02.640608 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 02:46:02.640608 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 02:46:02.640608 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a587f99c-5ad7-4fa2-945e-06954d45d44d could not be found. Aug 09 02:46:02.640608 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:46:02.640608 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:46:02.640608 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:46:02.640608 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:46:02.640608 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:46:02.640608 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:46:02.640608 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 02:46:02.640608 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 02:46:02.640608 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 02:46:02.641768 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 02:46:02.641768 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 02:46:02.641768 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 02:46:02.641768 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 02:46:02.641768 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 02:46:02.641768 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 02:46:02.641768 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 02:46:02.641768 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a587f99c-5ad7-4fa2-945e-06954d45d44d could not be found. Aug 09 02:46:02.641768 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:46:02.641768 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:46:02.641768 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:46:02.641768 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:46:02.641768 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:46:02.641768 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:46:02.641768 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 02:46:02.641768 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 02:46:02.641768 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a587f99c-5ad7-4fa2-945e-06954d45d44d could not be found. Aug 09 02:46:02.641768 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:46:02.642904 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-9cce9ec6-d574-40a0-a008-7283d5c3f761 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] Returning 404 to user: Instance a587f99c-5ad7-4fa2-945e-06954d45d44d could not be found. {{(pid=124425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 02:46:02.642904 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-9cce9ec6-d574-40a0-a008-7283d5c3f761 tempest-ServerRescueNegativeTestJSON-806361088 tempest-ServerRescueNegativeTestJSON-806361088-project] 10.222.0.20 "GET /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d" status: 404 len: 111 microversion: 2.1 time: 0.034535 Aug 09 02:46:02.642904 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 360/740] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:02 2022] GET /compute/v2.1/servers/a587f99c-5ad7-4fa2-945e-06954d45d44d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 02:46:02.872233 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-db7f6c5f-3f92-4989-8657-51ad06ea45aa tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:02.873184 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-db7f6c5f-3f92-4989-8657-51ad06ea45aa tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:02.879652 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-db7f6c5f-3f92-4989-8657-51ad06ea45aa tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:02.880351 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-db7f6c5f-3f92-4989-8657-51ad06ea45aa tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:02.880936 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-db7f6c5f-3f92-4989-8657-51ad06ea45aa tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:02.881785 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-db7f6c5f-3f92-4989-8657-51ad06ea45aa tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:02.882430 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-db7f6c5f-3f92-4989-8657-51ad06ea45aa tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:02.883001 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-db7f6c5f-3f92-4989-8657-51ad06ea45aa tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:02.915025 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.virt.hardware [None req-41c34add-ea0d-4008-8e88-e1983c37e9f3 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Flavor limits 0:0:0 {{(pid=124427) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 02:46:02.916512 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.virt.hardware [None req-41c34add-ea0d-4008-8e88-e1983c37e9f3 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Image limits 0:0:0 {{(pid=124427) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 02:46:02.917151 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.virt.hardware [None req-41c34add-ea0d-4008-8e88-e1983c37e9f3 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Flavor pref 0:0:0 {{(pid=124427) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 02:46:02.917736 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.virt.hardware [None req-41c34add-ea0d-4008-8e88-e1983c37e9f3 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Image pref 0:0:0 {{(pid=124427) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 02:46:02.918326 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.virt.hardware [None req-41c34add-ea0d-4008-8e88-e1983c37e9f3 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124427) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 02:46:02.931689 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-41c34add-ea0d-4008-8e88-e1983c37e9f3 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:02.932176 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-41c34add-ea0d-4008-8e88-e1983c37e9f3 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:02.932600 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-41c34add-ea0d-4008-8e88-e1983c37e9f3 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:02.933448 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-41c34add-ea0d-4008-8e88-e1983c37e9f3 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:02.934072 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-41c34add-ea0d-4008-8e88-e1983c37e9f3 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:02.934522 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-41c34add-ea0d-4008-8e88-e1983c37e9f3 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:02.954130 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.quota [None req-41c34add-ea0d-4008-8e88-e1983c37e9f3 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Getting quotas for project 9aadaf242f674436a45eae700fb52fc1. Resources: {'cores', 'ram', 'instances'} {{(pid=124427) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 02:46:02.959256 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.quota [None req-41c34add-ea0d-4008-8e88-e1983c37e9f3 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Getting quotas for user 90fa94f90d49485a81d502929bcd0b93 and project 9aadaf242f674436a45eae700fb52fc1. Resources: {'cores', 'ram', 'instances'} {{(pid=124427) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 02:46:02.962460 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-db7f6c5f-3f92-4989-8657-51ad06ea45aa tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:02.972425 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-db7f6c5f-3f92-4989-8657-51ad06ea45aa tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:02.974771 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-db7f6c5f-3f92-4989-8657-51ad06ea45aa tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:02.976255 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-db7f6c5f-3f92-4989-8657-51ad06ea45aa tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 200 len: 1338 microversion: 2.20 time: 0.108550 Aug 09 02:46:02.976968 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 361/741] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:46:02 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 1338 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 02:46:03.029457 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-41c34add-ea0d-4008-8e88-e1983c37e9f3 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Going to run 1 instances... {{(pid=124427) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 02:46:03.031377 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-41c34add-ea0d-4008-8e88-e1983c37e9f3 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 1dc382df-229f-4a7a-9275-51eefdf4ee9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='95a59f6e-74c4-481f-975c-c9cbff04562e',volume_size=None,volume_type=None)] {{(pid=124427) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 02:46:03.217012 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-41c34add-ea0d-4008-8e88-e1983c37e9f3 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.430478 Aug 09 02:46:03.218590 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 381/742] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Aug 9 02:46:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 1433 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 02:46:03.229957 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-897a3506-cec3-4e5d-b307-7db0d4cccc6f tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:03.230876 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-897a3506-cec3-4e5d-b307-7db0d4cccc6f tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 1dc382df-229f-4a7a-9275-51eefdf4ee9a] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:03.343416 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-897a3506-cec3-4e5d-b307-7db0d4cccc6f tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:03.351567 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-897a3506-cec3-4e5d-b307-7db0d4cccc6f tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/1dc382df-229f-4a7a-9275-51eefdf4ee9a" status: 200 len: 1093 microversion: 2.1 time: 0.125821 Aug 09 02:46:03.352146 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 362/743] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:03 2022] GET /compute/v2.1/servers/1dc382df-229f-4a7a-9275-51eefdf4ee9a => generated 1093 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:46:03.873485 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [req-6437ba21-0344-42d3-bcbc-49eef7585808 req-37fb85d3-d500-464e-962b-dec34c06d2ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01aef713-9cfa-4840-829f-b5d30b2f9549", "tag": "c771a4c1-387c-4632-a527-0af0b51cc089"}]} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:46:03.884147 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-6437ba21-0344-42d3-bcbc-49eef7585808 req-37fb85d3-d500-464e-962b-dec34c06d2ab service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:03.884846 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-6437ba21-0344-42d3-bcbc-49eef7585808 req-37fb85d3-d500-464e-962b-dec34c06d2ab service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:03.885454 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-6437ba21-0344-42d3-bcbc-49eef7585808 req-37fb85d3-d500-464e-962b-dec34c06d2ab service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:03.903495 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.compute.server_external_events [req-6437ba21-0344-42d3-bcbc-49eef7585808 req-37fb85d3-d500-464e-962b-dec34c06d2ab service nova] Creating event network-changed:c771a4c1-387c-4632-a527-0af0b51cc089 for instance 01aef713-9cfa-4840-829f-b5d30b2f9549 on hv-cinder-85246 Aug 09 02:46:03.911877 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [req-6437ba21-0344-42d3-bcbc-49eef7585808 req-37fb85d3-d500-464e-962b-dec34c06d2ab service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042804 Aug 09 02:46:03.913580 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 382/744] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:46:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:46:04.001513 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-b8fb89db-b13d-4cf4-a2df-3221e381a9dc tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:04.002125 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-b8fb89db-b13d-4cf4-a2df-3221e381a9dc tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:04.012381 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b8fb89db-b13d-4cf4-a2df-3221e381a9dc tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:04.013190 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b8fb89db-b13d-4cf4-a2df-3221e381a9dc tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:04.013848 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b8fb89db-b13d-4cf4-a2df-3221e381a9dc tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:04.014823 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b8fb89db-b13d-4cf4-a2df-3221e381a9dc tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:04.015731 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b8fb89db-b13d-4cf4-a2df-3221e381a9dc tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:04.016363 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b8fb89db-b13d-4cf4-a2df-3221e381a9dc tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:04.196603 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-b8fb89db-b13d-4cf4-a2df-3221e381a9dc tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:04.204998 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-b8fb89db-b13d-4cf4-a2df-3221e381a9dc tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:04.206585 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-b8fb89db-b13d-4cf4-a2df-3221e381a9dc tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:04.207673 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-b8fb89db-b13d-4cf4-a2df-3221e381a9dc tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 200 len: 1406 microversion: 2.20 time: 0.210711 Aug 09 02:46:04.208230 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 363/745] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:46:03 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 1406 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:46:04.376486 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-ec91df28-44cf-4bef-b2ff-730813c061cb tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:04.377263 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-ec91df28-44cf-4bef-b2ff-730813c061cb tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 1dc382df-229f-4a7a-9275-51eefdf4ee9a] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:04.386728 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:46:04.388516 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ec91df28-44cf-4bef-b2ff-730813c061cb tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:04.389162 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ec91df28-44cf-4bef-b2ff-730813c061cb tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:04.389742 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ec91df28-44cf-4bef-b2ff-730813c061cb tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:04.390952 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ec91df28-44cf-4bef-b2ff-730813c061cb tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:04.391726 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ec91df28-44cf-4bef-b2ff-730813c061cb tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:04.392219 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ec91df28-44cf-4bef-b2ff-730813c061cb tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:04.501134 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-ec91df28-44cf-4bef-b2ff-730813c061cb tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:04.503936 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_cell1:SELECT=100 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:46:04.515325 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-ec91df28-44cf-4bef-b2ff-730813c061cb tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/1dc382df-229f-4a7a-9275-51eefdf4ee9a" status: 200 len: 1191 microversion: 2.1 time: 0.144889 Aug 09 02:46:04.516439 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 383/746] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:04 2022] GET /compute/v2.1/servers/1dc382df-229f-4a7a-9275-51eefdf4ee9a => generated 1191 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:46:05.232055 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-1ccf9ee6-ef59-4552-a722-9b351290d04f tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:05.232669 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-1ccf9ee6-ef59-4552-a722-9b351290d04f tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:05.244523 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1ccf9ee6-ef59-4552-a722-9b351290d04f tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:05.244989 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1ccf9ee6-ef59-4552-a722-9b351290d04f tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:05.245422 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1ccf9ee6-ef59-4552-a722-9b351290d04f tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:05.246229 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1ccf9ee6-ef59-4552-a722-9b351290d04f tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:05.246888 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1ccf9ee6-ef59-4552-a722-9b351290d04f tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:05.247149 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1ccf9ee6-ef59-4552-a722-9b351290d04f tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:05.407656 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-1ccf9ee6-ef59-4552-a722-9b351290d04f tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:05.417551 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-1ccf9ee6-ef59-4552-a722-9b351290d04f tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:05.418904 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-1ccf9ee6-ef59-4552-a722-9b351290d04f tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:05.420050 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-1ccf9ee6-ef59-4552-a722-9b351290d04f tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 200 len: 1406 microversion: 2.20 time: 0.193276 Aug 09 02:46:05.420643 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 364/747] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:46:05 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 1406 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:46:05.537550 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-7940d657-54df-4b51-8c58-a24c53a027d6 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:05.538209 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-7940d657-54df-4b51-8c58-a24c53a027d6 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 1dc382df-229f-4a7a-9275-51eefdf4ee9a] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:05.549531 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7940d657-54df-4b51-8c58-a24c53a027d6 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:05.550051 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7940d657-54df-4b51-8c58-a24c53a027d6 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:05.550522 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7940d657-54df-4b51-8c58-a24c53a027d6 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:05.551242 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7940d657-54df-4b51-8c58-a24c53a027d6 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:05.551697 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7940d657-54df-4b51-8c58-a24c53a027d6 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:05.552116 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7940d657-54df-4b51-8c58-a24c53a027d6 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:05.616594 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-7940d657-54df-4b51-8c58-a24c53a027d6 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:05.624469 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-7940d657-54df-4b51-8c58-a24c53a027d6 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/1dc382df-229f-4a7a-9275-51eefdf4ee9a" status: 200 len: 1209 microversion: 2.1 time: 0.091076 Aug 09 02:46:05.625024 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 384/748] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:05 2022] GET /compute/v2.1/servers/1dc382df-229f-4a7a-9275-51eefdf4ee9a => generated 1209 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:46:06.443210 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-bf7325a0-160e-4018-8494-e7069988a9d3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:06.444420 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-bf7325a0-160e-4018-8494-e7069988a9d3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:06.450889 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-bf7325a0-160e-4018-8494-e7069988a9d3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:06.451366 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-bf7325a0-160e-4018-8494-e7069988a9d3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:06.451796 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-bf7325a0-160e-4018-8494-e7069988a9d3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:06.452504 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-bf7325a0-160e-4018-8494-e7069988a9d3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:06.453127 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-bf7325a0-160e-4018-8494-e7069988a9d3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:06.453549 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-bf7325a0-160e-4018-8494-e7069988a9d3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:06.458383 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:46:06.601457 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-bf7325a0-160e-4018-8494-e7069988a9d3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:06.610057 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-bf7325a0-160e-4018-8494-e7069988a9d3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:06.612138 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-bf7325a0-160e-4018-8494-e7069988a9d3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:06.613417 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-bf7325a0-160e-4018-8494-e7069988a9d3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 200 len: 1406 microversion: 2.20 time: 0.174413 Aug 09 02:46:06.614084 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 365/749] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:46:06 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 02:46:06.645788 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-36ffb561-6100-43e4-b019-f093b6617786 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:06.646455 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-36ffb561-6100-43e4-b019-f093b6617786 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 1dc382df-229f-4a7a-9275-51eefdf4ee9a] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:06.653062 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-36ffb561-6100-43e4-b019-f093b6617786 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:06.653477 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-36ffb561-6100-43e4-b019-f093b6617786 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:06.653905 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-36ffb561-6100-43e4-b019-f093b6617786 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:06.654622 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-36ffb561-6100-43e4-b019-f093b6617786 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:06.655068 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-36ffb561-6100-43e4-b019-f093b6617786 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:06.655480 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-36ffb561-6100-43e4-b019-f093b6617786 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:06.808920 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-36ffb561-6100-43e4-b019-f093b6617786 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:06.817994 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-36ffb561-6100-43e4-b019-f093b6617786 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/1dc382df-229f-4a7a-9275-51eefdf4ee9a" status: 200 len: 1265 microversion: 2.1 time: 0.176124 Aug 09 02:46:06.818791 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 385/750] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:06 2022] GET /compute/v2.1/servers/1dc382df-229f-4a7a-9275-51eefdf4ee9a => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:46:07.518552 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [req-2004055c-23c2-4f80-ad08-2aae6b0223b3 req-c904064e-e31b-4a6f-99a8-9b0e348ae950 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1dc382df-229f-4a7a-9275-51eefdf4ee9a", "tag": "4340fc7a-b008-41f2-a681-5a15abc0d9ba"}]} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:46:07.529868 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-2004055c-23c2-4f80-ad08-2aae6b0223b3 req-c904064e-e31b-4a6f-99a8-9b0e348ae950 service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:07.530739 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-2004055c-23c2-4f80-ad08-2aae6b0223b3 req-c904064e-e31b-4a6f-99a8-9b0e348ae950 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:07.531353 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-2004055c-23c2-4f80-ad08-2aae6b0223b3 req-c904064e-e31b-4a6f-99a8-9b0e348ae950 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:07.544087 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.compute.server_external_events [req-2004055c-23c2-4f80-ad08-2aae6b0223b3 req-c904064e-e31b-4a6f-99a8-9b0e348ae950 service nova] Creating event network-changed:4340fc7a-b008-41f2-a681-5a15abc0d9ba for instance 1dc382df-229f-4a7a-9275-51eefdf4ee9a on hv-cinder-85246 Aug 09 02:46:07.551300 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [req-2004055c-23c2-4f80-ad08-2aae6b0223b3 req-c904064e-e31b-4a6f-99a8-9b0e348ae950 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036428 Aug 09 02:46:07.552029 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 366/751] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:46:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:46:07.635970 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-4b0bba85-d57e-4279-b31f-bb463b8643f1 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:07.636889 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-4b0bba85-d57e-4279-b31f-bb463b8643f1 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:07.643324 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4b0bba85-d57e-4279-b31f-bb463b8643f1 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:07.643884 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4b0bba85-d57e-4279-b31f-bb463b8643f1 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:07.644386 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4b0bba85-d57e-4279-b31f-bb463b8643f1 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:07.645154 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4b0bba85-d57e-4279-b31f-bb463b8643f1 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:07.645708 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4b0bba85-d57e-4279-b31f-bb463b8643f1 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:07.646708 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4b0bba85-d57e-4279-b31f-bb463b8643f1 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:07.794860 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-4b0bba85-d57e-4279-b31f-bb463b8643f1 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:07.804615 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-4b0bba85-d57e-4279-b31f-bb463b8643f1 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:07.807499 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-4b0bba85-d57e-4279-b31f-bb463b8643f1 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:07.810915 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-4b0bba85-d57e-4279-b31f-bb463b8643f1 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 200 len: 1406 microversion: 2.20 time: 0.178486 Aug 09 02:46:07.811875 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 386/752] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:46:07 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 1406 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:46:07.840460 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-f8987135-d7c5-47b1-96fa-770f1758fea5 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:07.841549 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-f8987135-d7c5-47b1-96fa-770f1758fea5 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 1dc382df-229f-4a7a-9275-51eefdf4ee9a] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:07.848257 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f8987135-d7c5-47b1-96fa-770f1758fea5 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:07.848964 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f8987135-d7c5-47b1-96fa-770f1758fea5 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:07.850842 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f8987135-d7c5-47b1-96fa-770f1758fea5 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:07.852101 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f8987135-d7c5-47b1-96fa-770f1758fea5 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:07.852832 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f8987135-d7c5-47b1-96fa-770f1758fea5 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:07.853413 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f8987135-d7c5-47b1-96fa-770f1758fea5 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:08.003210 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-f8987135-d7c5-47b1-96fa-770f1758fea5 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:08.011890 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-f8987135-d7c5-47b1-96fa-770f1758fea5 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/1dc382df-229f-4a7a-9275-51eefdf4ee9a" status: 200 len: 1265 microversion: 2.1 time: 0.176245 Aug 09 02:46:08.013406 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 367/753] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:07 2022] GET /compute/v2.1/servers/1dc382df-229f-4a7a-9275-51eefdf4ee9a => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:46:08.833517 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-4c847ab2-4270-4e9e-bec7-f41f82d50e36 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:08.834120 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-4c847ab2-4270-4e9e-bec7-f41f82d50e36 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:08.841539 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4c847ab2-4270-4e9e-bec7-f41f82d50e36 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:08.842104 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4c847ab2-4270-4e9e-bec7-f41f82d50e36 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:08.842572 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4c847ab2-4270-4e9e-bec7-f41f82d50e36 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:08.843245 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4c847ab2-4270-4e9e-bec7-f41f82d50e36 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:08.843883 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4c847ab2-4270-4e9e-bec7-f41f82d50e36 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:08.844317 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4c847ab2-4270-4e9e-bec7-f41f82d50e36 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:08.982091 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-4c847ab2-4270-4e9e-bec7-f41f82d50e36 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:08.991034 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-4c847ab2-4270-4e9e-bec7-f41f82d50e36 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:08.992663 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-4c847ab2-4270-4e9e-bec7-f41f82d50e36 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:08.993787 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-4c847ab2-4270-4e9e-bec7-f41f82d50e36 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 200 len: 1406 microversion: 2.20 time: 0.164224 Aug 09 02:46:08.994394 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 387/754] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:46:08 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:46:09.033126 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-dfdf5376-c8e7-4034-868c-383bba2d2d31 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:09.033908 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-dfdf5376-c8e7-4034-868c-383bba2d2d31 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 1dc382df-229f-4a7a-9275-51eefdf4ee9a] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:09.040640 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-dfdf5376-c8e7-4034-868c-383bba2d2d31 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:09.041127 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-dfdf5376-c8e7-4034-868c-383bba2d2d31 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:09.041566 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-dfdf5376-c8e7-4034-868c-383bba2d2d31 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:09.042380 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-dfdf5376-c8e7-4034-868c-383bba2d2d31 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:09.042833 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-dfdf5376-c8e7-4034-868c-383bba2d2d31 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:09.043252 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-dfdf5376-c8e7-4034-868c-383bba2d2d31 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:09.180710 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-dfdf5376-c8e7-4034-868c-383bba2d2d31 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:09.188280 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-dfdf5376-c8e7-4034-868c-383bba2d2d31 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/1dc382df-229f-4a7a-9275-51eefdf4ee9a" status: 200 len: 1265 microversion: 2.1 time: 0.159228 Aug 09 02:46:09.188844 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 368/755] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:09 2022] GET /compute/v2.1/servers/1dc382df-229f-4a7a-9275-51eefdf4ee9a => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:46:10.016757 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-497c7075-cc5e-4d18-9590-c1ba84038878 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:10.017611 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-497c7075-cc5e-4d18-9590-c1ba84038878 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:10.019843 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_cell0:SELECT=2 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:46:10.025632 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-497c7075-cc5e-4d18-9590-c1ba84038878 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:10.026114 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-497c7075-cc5e-4d18-9590-c1ba84038878 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:10.026637 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-497c7075-cc5e-4d18-9590-c1ba84038878 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:10.027540 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-497c7075-cc5e-4d18-9590-c1ba84038878 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:10.028154 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-497c7075-cc5e-4d18-9590-c1ba84038878 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:10.028573 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-497c7075-cc5e-4d18-9590-c1ba84038878 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:10.092264 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [req-90ca8e3e-6100-4128-9d59-29cc81adf57a req-f0f01c60-444b-452d-b007-fc1d191404ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01aef713-9cfa-4840-829f-b5d30b2f9549", "name": "network-vif-plugged", "status": "completed", "tag": "c771a4c1-387c-4632-a527-0af0b51cc089"}]} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:46:10.102474 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-90ca8e3e-6100-4128-9d59-29cc81adf57a req-f0f01c60-444b-452d-b007-fc1d191404ad service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:10.103201 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-90ca8e3e-6100-4128-9d59-29cc81adf57a req-f0f01c60-444b-452d-b007-fc1d191404ad service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:10.103619 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-90ca8e3e-6100-4128-9d59-29cc81adf57a req-f0f01c60-444b-452d-b007-fc1d191404ad service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:10.115417 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.compute.server_external_events [req-90ca8e3e-6100-4128-9d59-29cc81adf57a req-f0f01c60-444b-452d-b007-fc1d191404ad service nova] Creating event network-vif-plugged:c771a4c1-387c-4632-a527-0af0b51cc089 for instance 01aef713-9cfa-4840-829f-b5d30b2f9549 on hv-cinder-85246 Aug 09 02:46:10.121352 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [req-90ca8e3e-6100-4128-9d59-29cc81adf57a req-f0f01c60-444b-452d-b007-fc1d191404ad service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.231506 Aug 09 02:46:10.122079 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 388/756] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:46:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:46:10.171907 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-497c7075-cc5e-4d18-9590-c1ba84038878 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:10.180429 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-497c7075-cc5e-4d18-9590-c1ba84038878 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:10.182704 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-497c7075-cc5e-4d18-9590-c1ba84038878 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:10.184211 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-497c7075-cc5e-4d18-9590-c1ba84038878 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 200 len: 1406 microversion: 2.20 time: 0.171416 Aug 09 02:46:10.184802 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 369/757] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:46:10 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 02:46:10.217073 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-7c53edbf-0f5a-448b-b1c8-a281c4a498ab tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:10.218765 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-7c53edbf-0f5a-448b-b1c8-a281c4a498ab tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 1dc382df-229f-4a7a-9275-51eefdf4ee9a] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:10.226108 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7c53edbf-0f5a-448b-b1c8-a281c4a498ab tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:10.226703 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7c53edbf-0f5a-448b-b1c8-a281c4a498ab tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:10.227276 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7c53edbf-0f5a-448b-b1c8-a281c4a498ab tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:10.228076 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7c53edbf-0f5a-448b-b1c8-a281c4a498ab tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:10.228526 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7c53edbf-0f5a-448b-b1c8-a281c4a498ab tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:10.228966 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7c53edbf-0f5a-448b-b1c8-a281c4a498ab tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:10.368819 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-7c53edbf-0f5a-448b-b1c8-a281c4a498ab tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:10.376771 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-7c53edbf-0f5a-448b-b1c8-a281c4a498ab tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/1dc382df-229f-4a7a-9275-51eefdf4ee9a" status: 200 len: 1265 microversion: 2.1 time: 0.171451 Aug 09 02:46:10.377360 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 389/758] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:10 2022] GET /compute/v2.1/servers/1dc382df-229f-4a7a-9275-51eefdf4ee9a => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:46:11.206601 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-fe4f577d-0962-40cd-a9a7-8bd7aa82e922 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:11.207429 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-fe4f577d-0962-40cd-a9a7-8bd7aa82e922 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:11.214063 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-fe4f577d-0962-40cd-a9a7-8bd7aa82e922 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:11.214577 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-fe4f577d-0962-40cd-a9a7-8bd7aa82e922 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:11.215005 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-fe4f577d-0962-40cd-a9a7-8bd7aa82e922 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:11.215689 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-fe4f577d-0962-40cd-a9a7-8bd7aa82e922 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:11.216118 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-fe4f577d-0962-40cd-a9a7-8bd7aa82e922 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:11.216723 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-fe4f577d-0962-40cd-a9a7-8bd7aa82e922 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:11.351541 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-fe4f577d-0962-40cd-a9a7-8bd7aa82e922 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:11.361460 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-fe4f577d-0962-40cd-a9a7-8bd7aa82e922 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:11.363039 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-fe4f577d-0962-40cd-a9a7-8bd7aa82e922 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:11.364157 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-fe4f577d-0962-40cd-a9a7-8bd7aa82e922 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 200 len: 1406 microversion: 2.20 time: 0.161611 Aug 09 02:46:11.364687 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 370/759] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:46:11 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:46:11.397514 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-c16cc4d6-7158-465c-9ae3-61d8f41bceb5 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:11.398277 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-c16cc4d6-7158-465c-9ae3-61d8f41bceb5 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 1dc382df-229f-4a7a-9275-51eefdf4ee9a] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:11.404853 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-c16cc4d6-7158-465c-9ae3-61d8f41bceb5 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:11.405339 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-c16cc4d6-7158-465c-9ae3-61d8f41bceb5 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:11.405775 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-c16cc4d6-7158-465c-9ae3-61d8f41bceb5 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:11.406505 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-c16cc4d6-7158-465c-9ae3-61d8f41bceb5 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:11.406953 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-c16cc4d6-7158-465c-9ae3-61d8f41bceb5 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:11.407376 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-c16cc4d6-7158-465c-9ae3-61d8f41bceb5 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:11.553138 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-c16cc4d6-7158-465c-9ae3-61d8f41bceb5 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:11.561639 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-c16cc4d6-7158-465c-9ae3-61d8f41bceb5 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/1dc382df-229f-4a7a-9275-51eefdf4ee9a" status: 200 len: 1265 microversion: 2.1 time: 0.168129 Aug 09 02:46:11.562224 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 390/760] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:11 2022] GET /compute/v2.1/servers/1dc382df-229f-4a7a-9275-51eefdf4ee9a => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:46:12.387302 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-8d260371-20c4-4eea-bd18-2eac103ca6e3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:12.388055 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-8d260371-20c4-4eea-bd18-2eac103ca6e3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:12.398134 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8d260371-20c4-4eea-bd18-2eac103ca6e3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:12.398661 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8d260371-20c4-4eea-bd18-2eac103ca6e3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:12.399077 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8d260371-20c4-4eea-bd18-2eac103ca6e3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:12.400136 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8d260371-20c4-4eea-bd18-2eac103ca6e3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:12.400592 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8d260371-20c4-4eea-bd18-2eac103ca6e3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:12.401014 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8d260371-20c4-4eea-bd18-2eac103ca6e3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:12.533798 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-8d260371-20c4-4eea-bd18-2eac103ca6e3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:12.542581 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-8d260371-20c4-4eea-bd18-2eac103ca6e3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:12.543884 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-8d260371-20c4-4eea-bd18-2eac103ca6e3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:12.545150 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-8d260371-20c4-4eea-bd18-2eac103ca6e3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 200 len: 1596 microversion: 2.20 time: 0.162187 Aug 09 02:46:12.545790 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 371/761] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:46:12 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 1596 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:46:12.568006 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-783c9d00-dc0f-4be3-8d55-56e9db3a7b7d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:12.568651 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-783c9d00-dc0f-4be3-8d55-56e9db3a7b7d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:12.575536 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-783c9d00-dc0f-4be3-8d55-56e9db3a7b7d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:12.576046 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-783c9d00-dc0f-4be3-8d55-56e9db3a7b7d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:12.576472 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-783c9d00-dc0f-4be3-8d55-56e9db3a7b7d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:12.577455 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-783c9d00-dc0f-4be3-8d55-56e9db3a7b7d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:12.577910 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-783c9d00-dc0f-4be3-8d55-56e9db3a7b7d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:12.578365 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-783c9d00-dc0f-4be3-8d55-56e9db3a7b7d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:12.582406 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-e01eb596-6e83-497d-8d44-926774c3a04b tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:12.583239 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-e01eb596-6e83-497d-8d44-926774c3a04b tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 1dc382df-229f-4a7a-9275-51eefdf4ee9a] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:12.589586 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e01eb596-6e83-497d-8d44-926774c3a04b tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:12.590140 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e01eb596-6e83-497d-8d44-926774c3a04b tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:12.590825 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e01eb596-6e83-497d-8d44-926774c3a04b tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:12.591577 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e01eb596-6e83-497d-8d44-926774c3a04b tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:12.592090 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e01eb596-6e83-497d-8d44-926774c3a04b tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:12.593331 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e01eb596-6e83-497d-8d44-926774c3a04b tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:12.695668 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-783c9d00-dc0f-4be3-8d55-56e9db3a7b7d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.131825 Aug 09 02:46:12.696264 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 391/762] 10.222.0.20 () {60 vars in 1316 bytes} [Tue Aug 9 02:46:12 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549/os-interface => generated 284 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 02:46:12.770437 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-e01eb596-6e83-497d-8d44-926774c3a04b tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:12.778980 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-e01eb596-6e83-497d-8d44-926774c3a04b tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/1dc382df-229f-4a7a-9275-51eefdf4ee9a" status: 200 len: 1265 microversion: 2.1 time: 0.200621 Aug 09 02:46:12.779709 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 372/763] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:12 2022] GET /compute/v2.1/servers/1dc382df-229f-4a7a-9275-51eefdf4ee9a => generated 1265 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:46:13.644952 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_cell0:SELECT=2 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:46:13.646371 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_cell0:SELECT=12 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:46:13.651281 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [req-eeea5a47-8dc5-4be9-83a8-66a9ebf526cf req-f18e8846-ab56-4e38-932a-ea64545588fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01aef713-9cfa-4840-829f-b5d30b2f9549", "tag": "c771a4c1-387c-4632-a527-0af0b51cc089"}]} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:46:13.661866 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-eeea5a47-8dc5-4be9-83a8-66a9ebf526cf req-f18e8846-ab56-4e38-932a-ea64545588fe service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:13.662371 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-eeea5a47-8dc5-4be9-83a8-66a9ebf526cf req-f18e8846-ab56-4e38-932a-ea64545588fe service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:13.662814 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-eeea5a47-8dc5-4be9-83a8-66a9ebf526cf req-f18e8846-ab56-4e38-932a-ea64545588fe service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:13.677390 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.compute.server_external_events [req-eeea5a47-8dc5-4be9-83a8-66a9ebf526cf req-f18e8846-ab56-4e38-932a-ea64545588fe service nova] Creating event network-changed:c771a4c1-387c-4632-a527-0af0b51cc089 for instance 01aef713-9cfa-4840-829f-b5d30b2f9549 on hv-cinder-85246 Aug 09 02:46:13.682726 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [req-eeea5a47-8dc5-4be9-83a8-66a9ebf526cf req-f18e8846-ab56-4e38-932a-ea64545588fe service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039291 Aug 09 02:46:13.686890 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 392/764] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:46:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:46:13.800143 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-cdf169f7-c8dc-4085-9a8b-d4b795f43303 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:13.800698 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-cdf169f7-c8dc-4085-9a8b-d4b795f43303 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 1dc382df-229f-4a7a-9275-51eefdf4ee9a] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:13.803705 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_cell0:SELECT=8 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:46:13.807906 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-cdf169f7-c8dc-4085-9a8b-d4b795f43303 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:13.808460 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-cdf169f7-c8dc-4085-9a8b-d4b795f43303 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:13.808959 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-cdf169f7-c8dc-4085-9a8b-d4b795f43303 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:13.809720 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-cdf169f7-c8dc-4085-9a8b-d4b795f43303 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:13.810293 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-cdf169f7-c8dc-4085-9a8b-d4b795f43303 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:13.810800 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-cdf169f7-c8dc-4085-9a8b-d4b795f43303 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:13.954503 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-cdf169f7-c8dc-4085-9a8b-d4b795f43303 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:13.965238 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-cdf169f7-c8dc-4085-9a8b-d4b795f43303 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/1dc382df-229f-4a7a-9275-51eefdf4ee9a" status: 200 len: 1265 microversion: 2.1 time: 0.169886 Aug 09 02:46:13.978375 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 373/765] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:13 2022] GET /compute/v2.1/servers/1dc382df-229f-4a7a-9275-51eefdf4ee9a => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:46:14.988455 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-d7b2cf06-cc1a-489e-b625-3286ae882b7d tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:14.989124 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-d7b2cf06-cc1a-489e-b625-3286ae882b7d tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 1dc382df-229f-4a7a-9275-51eefdf4ee9a] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:14.995342 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d7b2cf06-cc1a-489e-b625-3286ae882b7d tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:14.995816 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d7b2cf06-cc1a-489e-b625-3286ae882b7d tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:14.996237 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d7b2cf06-cc1a-489e-b625-3286ae882b7d tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:14.996916 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d7b2cf06-cc1a-489e-b625-3286ae882b7d tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:14.997357 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d7b2cf06-cc1a-489e-b625-3286ae882b7d tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:14.997766 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d7b2cf06-cc1a-489e-b625-3286ae882b7d tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:15.138071 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-d7b2cf06-cc1a-489e-b625-3286ae882b7d tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:15.145903 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-d7b2cf06-cc1a-489e-b625-3286ae882b7d tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/1dc382df-229f-4a7a-9275-51eefdf4ee9a" status: 200 len: 1265 microversion: 2.1 time: 0.162544 Aug 09 02:46:15.146572 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 393/766] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:14 2022] GET /compute/v2.1/servers/1dc382df-229f-4a7a-9275-51eefdf4ee9a => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:46:15.568609 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-b7f68c89-1184-46da-9185-95fbba234c03 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:46:15.569147 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-b7f68c89-1184-46da-9185-95fbba234c03 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] [instance: 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:15.575853 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b7f68c89-1184-46da-9185-95fbba234c03 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:15.576393 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b7f68c89-1184-46da-9185-95fbba234c03 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:15.576828 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b7f68c89-1184-46da-9185-95fbba234c03 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:15.577520 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b7f68c89-1184-46da-9185-95fbba234c03 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:15.578042 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b7f68c89-1184-46da-9185-95fbba234c03 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:15.578397 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b7f68c89-1184-46da-9185-95fbba234c03 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:15.601447 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.objects.instance [None req-b7f68c89-1184-46da-9185-95fbba234c03 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lazy-loading 'flavor' on Instance uuid 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b {{(pid=124425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 02:46:15.678404 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-b7f68c89-1184-46da-9185-95fbba234c03 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] 10.222.0.20 "POST /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b/action" status: 202 len: 0 microversion: 2.1 time: 0.114172 Aug 09 02:46:15.679400 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 374/767] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Aug 9 02:46:15 2022] POST /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 02:46:15.688737 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-19bbbff1-1e8f-4f50-9016-789b20fe0857 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:15.689752 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-19bbbff1-1e8f-4f50-9016-789b20fe0857 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] [instance: 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:15.696175 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-19bbbff1-1e8f-4f50-9016-789b20fe0857 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:15.696892 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-19bbbff1-1e8f-4f50-9016-789b20fe0857 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:15.697470 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-19bbbff1-1e8f-4f50-9016-789b20fe0857 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:15.698593 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-19bbbff1-1e8f-4f50-9016-789b20fe0857 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:15.699231 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-19bbbff1-1e8f-4f50-9016-789b20fe0857 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:15.699645 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-19bbbff1-1e8f-4f50-9016-789b20fe0857 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:15.847943 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-19bbbff1-1e8f-4f50-9016-789b20fe0857 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96475caac28419eb0b7dd78375e9e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5d24d2b8dc4844a48a76ed2ea2cffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:15.858211 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-19bbbff1-1e8f-4f50-9016-789b20fe0857 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] 10.222.0.20 "GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b" status: 200 len: 1567 microversion: 2.1 time: 0.174291 Aug 09 02:46:15.858797 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 394/768] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:15 2022] GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:46:16.168321 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-7cc589cf-5115-4fb4-bfed-b4450e3e1eff tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:16.169101 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-7cc589cf-5115-4fb4-bfed-b4450e3e1eff tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 1dc382df-229f-4a7a-9275-51eefdf4ee9a] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:16.176947 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7cc589cf-5115-4fb4-bfed-b4450e3e1eff tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:16.177608 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7cc589cf-5115-4fb4-bfed-b4450e3e1eff tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:16.178302 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7cc589cf-5115-4fb4-bfed-b4450e3e1eff tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:16.179336 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7cc589cf-5115-4fb4-bfed-b4450e3e1eff tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:16.180003 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7cc589cf-5115-4fb4-bfed-b4450e3e1eff tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:16.180612 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7cc589cf-5115-4fb4-bfed-b4450e3e1eff tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:16.328010 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-7cc589cf-5115-4fb4-bfed-b4450e3e1eff tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:16.337048 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-7cc589cf-5115-4fb4-bfed-b4450e3e1eff tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/1dc382df-229f-4a7a-9275-51eefdf4ee9a" status: 200 len: 1265 microversion: 2.1 time: 0.173580 Aug 09 02:46:16.337609 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 375/769] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:16 2022] GET /compute/v2.1/servers/1dc382df-229f-4a7a-9275-51eefdf4ee9a => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:46:16.880934 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-bb9d3a53-1cb7-49a9-8789-84926a8a3059 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:16.881616 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-bb9d3a53-1cb7-49a9-8789-84926a8a3059 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] [instance: 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:16.887924 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-bb9d3a53-1cb7-49a9-8789-84926a8a3059 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:16.888401 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-bb9d3a53-1cb7-49a9-8789-84926a8a3059 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:16.888829 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-bb9d3a53-1cb7-49a9-8789-84926a8a3059 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:16.889492 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-bb9d3a53-1cb7-49a9-8789-84926a8a3059 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:16.889937 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-bb9d3a53-1cb7-49a9-8789-84926a8a3059 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:16.890399 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-bb9d3a53-1cb7-49a9-8789-84926a8a3059 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:16.913991 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-e5f8886c-471b-4a4d-90e8-ab76304387eb tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:16.914573 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-e5f8886c-471b-4a4d-90e8-ab76304387eb tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: ac4668e2-6e51-4087-bfca-a22cff3b147f] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:16.920434 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e5f8886c-471b-4a4d-90e8-ab76304387eb tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:16.920909 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e5f8886c-471b-4a4d-90e8-ab76304387eb tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:16.921330 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e5f8886c-471b-4a4d-90e8-ab76304387eb tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:16.922009 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e5f8886c-471b-4a4d-90e8-ab76304387eb tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:16.922475 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e5f8886c-471b-4a4d-90e8-ab76304387eb tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:16.922886 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e5f8886c-471b-4a4d-90e8-ab76304387eb tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:16.946486 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-e5f8886c-471b-4a4d-90e8-ab76304387eb tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f/ips" status: 200 len: 144 microversion: 2.1 time: 0.212617 Aug 09 02:46:16.947051 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 395/770] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Aug 9 02:46:16 2022] GET /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f/ips => generated 144 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:46:17.028353 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-bb9d3a53-1cb7-49a9-8789-84926a8a3059 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96475caac28419eb0b7dd78375e9e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5d24d2b8dc4844a48a76ed2ea2cffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:17.036449 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-bb9d3a53-1cb7-49a9-8789-84926a8a3059 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] 10.222.0.20 "GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b" status: 200 len: 1567 microversion: 2.1 time: 0.159377 Aug 09 02:46:17.037315 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 376/771] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:16 2022] GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:46:17.358428 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-03fb415d-e743-42ad-9771-7c7d35f0b968 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:17.359036 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-03fb415d-e743-42ad-9771-7c7d35f0b968 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 1dc382df-229f-4a7a-9275-51eefdf4ee9a] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:17.365774 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-03fb415d-e743-42ad-9771-7c7d35f0b968 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:17.366185 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-03fb415d-e743-42ad-9771-7c7d35f0b968 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:17.366633 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-03fb415d-e743-42ad-9771-7c7d35f0b968 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:17.367315 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-03fb415d-e743-42ad-9771-7c7d35f0b968 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:17.367762 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-03fb415d-e743-42ad-9771-7c7d35f0b968 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:17.368173 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-03fb415d-e743-42ad-9771-7c7d35f0b968 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:17.504172 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-03fb415d-e743-42ad-9771-7c7d35f0b968 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:17.512066 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-03fb415d-e743-42ad-9771-7c7d35f0b968 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/1dc382df-229f-4a7a-9275-51eefdf4ee9a" status: 200 len: 1265 microversion: 2.1 time: 0.157563 Aug 09 02:46:17.512640 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 396/772] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:17 2022] GET /compute/v2.1/servers/1dc382df-229f-4a7a-9275-51eefdf4ee9a => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:46:17.921639 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [req-7e66dd9e-3bf5-49dc-8f25-9d010fcce8a8 req-471df43b-cc23-4053-b4e1-c55fc29e23f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dc382df-229f-4a7a-9275-51eefdf4ee9a", "name": "network-vif-plugged", "status": "completed", "tag": "4340fc7a-b008-41f2-a681-5a15abc0d9ba"}]} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:46:17.927333 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:46:17.934698 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-7e66dd9e-3bf5-49dc-8f25-9d010fcce8a8 req-471df43b-cc23-4053-b4e1-c55fc29e23f3 service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:17.935177 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-7e66dd9e-3bf5-49dc-8f25-9d010fcce8a8 req-471df43b-cc23-4053-b4e1-c55fc29e23f3 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:17.935605 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-7e66dd9e-3bf5-49dc-8f25-9d010fcce8a8 req-471df43b-cc23-4053-b4e1-c55fc29e23f3 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:17.948923 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.compute.server_external_events [req-7e66dd9e-3bf5-49dc-8f25-9d010fcce8a8 req-471df43b-cc23-4053-b4e1-c55fc29e23f3 service nova] Creating event network-vif-plugged:4340fc7a-b008-41f2-a681-5a15abc0d9ba for instance 1dc382df-229f-4a7a-9275-51eefdf4ee9a on hv-cinder-85246 Aug 09 02:46:17.954110 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [req-7e66dd9e-3bf5-49dc-8f25-9d010fcce8a8 req-471df43b-cc23-4053-b4e1-c55fc29e23f3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036374 Aug 09 02:46:17.955426 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 377/773] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:46:18.061497 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-0184c3e6-3935-47af-9c08-c5e8d3983aa0 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:18.062088 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-0184c3e6-3935-47af-9c08-c5e8d3983aa0 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] [instance: 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:18.068866 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0184c3e6-3935-47af-9c08-c5e8d3983aa0 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:18.069348 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0184c3e6-3935-47af-9c08-c5e8d3983aa0 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:18.069782 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0184c3e6-3935-47af-9c08-c5e8d3983aa0 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:18.070517 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0184c3e6-3935-47af-9c08-c5e8d3983aa0 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:18.070968 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0184c3e6-3935-47af-9c08-c5e8d3983aa0 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:18.071461 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0184c3e6-3935-47af-9c08-c5e8d3983aa0 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:18.213532 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-0184c3e6-3935-47af-9c08-c5e8d3983aa0 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96475caac28419eb0b7dd78375e9e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5d24d2b8dc4844a48a76ed2ea2cffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:18.221603 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-0184c3e6-3935-47af-9c08-c5e8d3983aa0 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] 10.222.0.20 "GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b" status: 200 len: 1567 microversion: 2.1 time: 0.164309 Aug 09 02:46:18.222976 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 397/774] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:18 2022] GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:46:18.310221 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-9124de1d-6279-459c-bff1-184000fb1628 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f39b529d-8d74-4efa-ae4c-6a7ca5183dae"}} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:46:18.312921 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-9124de1d-6279-459c-bff1-184000fb1628 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: ac4668e2-6e51-4087-bfca-a22cff3b147f] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:18.320034 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9124de1d-6279-459c-bff1-184000fb1628 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:18.320518 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9124de1d-6279-459c-bff1-184000fb1628 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:18.320945 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9124de1d-6279-459c-bff1-184000fb1628 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:18.321664 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9124de1d-6279-459c-bff1-184000fb1628 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:18.322116 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9124de1d-6279-459c-bff1-184000fb1628 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:18.323175 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9124de1d-6279-459c-bff1-184000fb1628 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:18.533354 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-8dc4b894-0ceb-437f-b553-82fdf0443a04 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:18.534251 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-8dc4b894-0ceb-437f-b553-82fdf0443a04 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 1dc382df-229f-4a7a-9275-51eefdf4ee9a] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:18.541838 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8dc4b894-0ceb-437f-b553-82fdf0443a04 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:18.542399 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8dc4b894-0ceb-437f-b553-82fdf0443a04 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:18.542785 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8dc4b894-0ceb-437f-b553-82fdf0443a04 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:18.543569 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8dc4b894-0ceb-437f-b553-82fdf0443a04 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:18.544022 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8dc4b894-0ceb-437f-b553-82fdf0443a04 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:18.544448 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8dc4b894-0ceb-437f-b553-82fdf0443a04 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:18.681207 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-8dc4b894-0ceb-437f-b553-82fdf0443a04 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:18.689538 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-8dc4b894-0ceb-437f-b553-82fdf0443a04 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/1dc382df-229f-4a7a-9275-51eefdf4ee9a" status: 200 len: 1265 microversion: 2.1 time: 0.160489 Aug 09 02:46:18.690111 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 398/775] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:18 2022] GET /compute/v2.1/servers/1dc382df-229f-4a7a-9275-51eefdf4ee9a => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:46:19.244308 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-d44d61dc-17f4-483c-8bac-17f11da6fc99 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:19.244992 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-d44d61dc-17f4-483c-8bac-17f11da6fc99 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] [instance: 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:19.251479 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d44d61dc-17f4-483c-8bac-17f11da6fc99 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:19.252021 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d44d61dc-17f4-483c-8bac-17f11da6fc99 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:19.252413 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d44d61dc-17f4-483c-8bac-17f11da6fc99 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:19.253114 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d44d61dc-17f4-483c-8bac-17f11da6fc99 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:19.253540 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d44d61dc-17f4-483c-8bac-17f11da6fc99 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:19.253986 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d44d61dc-17f4-483c-8bac-17f11da6fc99 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:19.271940 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-9124de1d-6279-459c-bff1-184000fb1628 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "POST /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.967255 Aug 09 02:46:19.273008 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 378/776] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Aug 9 02:46:18 2022] POST /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f/os-volume_attachments => generated 194 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:46:19.392068 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-d44d61dc-17f4-483c-8bac-17f11da6fc99 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96475caac28419eb0b7dd78375e9e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5d24d2b8dc4844a48a76ed2ea2cffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:19.399899 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-d44d61dc-17f4-483c-8bac-17f11da6fc99 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] 10.222.0.20 "GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b" status: 200 len: 1567 microversion: 2.1 time: 0.159542 Aug 09 02:46:19.400464 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 399/777] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:19 2022] GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:46:19.711517 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-6ea25c67-d5ee-42b7-8666-8a4b8348bed8 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:19.712217 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-6ea25c67-d5ee-42b7-8666-8a4b8348bed8 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 1dc382df-229f-4a7a-9275-51eefdf4ee9a] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:19.719811 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6ea25c67-d5ee-42b7-8666-8a4b8348bed8 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:19.720349 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6ea25c67-d5ee-42b7-8666-8a4b8348bed8 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:19.720783 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6ea25c67-d5ee-42b7-8666-8a4b8348bed8 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:19.721601 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6ea25c67-d5ee-42b7-8666-8a4b8348bed8 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:19.722047 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6ea25c67-d5ee-42b7-8666-8a4b8348bed8 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:19.722577 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6ea25c67-d5ee-42b7-8666-8a4b8348bed8 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:19.855108 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-6ea25c67-d5ee-42b7-8666-8a4b8348bed8 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:19.857430 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:46:19.864188 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-6ea25c67-d5ee-42b7-8666-8a4b8348bed8 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/1dc382df-229f-4a7a-9275-51eefdf4ee9a" status: 200 len: 1265 microversion: 2.1 time: 0.157365 Aug 09 02:46:19.864785 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 379/778] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:19 2022] GET /compute/v2.1/servers/1dc382df-229f-4a7a-9275-51eefdf4ee9a => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:46:20.423014 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-015e358d-070c-41b5-ad6d-4775da01892a tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:20.423014 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-015e358d-070c-41b5-ad6d-4775da01892a tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] [instance: 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:20.428556 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-015e358d-070c-41b5-ad6d-4775da01892a tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:20.429035 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-015e358d-070c-41b5-ad6d-4775da01892a tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:20.429471 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-015e358d-070c-41b5-ad6d-4775da01892a tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:20.430185 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-015e358d-070c-41b5-ad6d-4775da01892a tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:20.430637 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-015e358d-070c-41b5-ad6d-4775da01892a tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:20.431054 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-015e358d-070c-41b5-ad6d-4775da01892a tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:20.567741 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-015e358d-070c-41b5-ad6d-4775da01892a tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96475caac28419eb0b7dd78375e9e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5d24d2b8dc4844a48a76ed2ea2cffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:20.577287 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-015e358d-070c-41b5-ad6d-4775da01892a tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] 10.222.0.20 "GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b" status: 200 len: 1567 microversion: 2.1 time: 0.160125 Aug 09 02:46:20.577851 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 400/779] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:20 2022] GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:46:20.888320 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-3b337b8d-cd04-43ca-b944-8b69297189bb tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:20.889349 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-3b337b8d-cd04-43ca-b944-8b69297189bb tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 1dc382df-229f-4a7a-9275-51eefdf4ee9a] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:20.900684 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3b337b8d-cd04-43ca-b944-8b69297189bb tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:20.901475 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3b337b8d-cd04-43ca-b944-8b69297189bb tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:20.902325 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3b337b8d-cd04-43ca-b944-8b69297189bb tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:20.903453 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3b337b8d-cd04-43ca-b944-8b69297189bb tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:20.904198 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3b337b8d-cd04-43ca-b944-8b69297189bb tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:20.904898 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3b337b8d-cd04-43ca-b944-8b69297189bb tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:21.048301 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-3b337b8d-cd04-43ca-b944-8b69297189bb tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:21.056039 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-3b337b8d-cd04-43ca-b944-8b69297189bb tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/1dc382df-229f-4a7a-9275-51eefdf4ee9a" status: 200 len: 1452 microversion: 2.1 time: 0.174428 Aug 09 02:46:21.056599 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 380/780] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:20 2022] GET /compute/v2.1/servers/1dc382df-229f-4a7a-9275-51eefdf4ee9a => generated 1452 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:46:21.076266 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-7b9d9415-2a1f-4968-8a64-ec06a6c537a3 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:21.076914 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-7b9d9415-2a1f-4968-8a64-ec06a6c537a3 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 1dc382df-229f-4a7a-9275-51eefdf4ee9a] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:21.083511 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7b9d9415-2a1f-4968-8a64-ec06a6c537a3 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:21.084067 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7b9d9415-2a1f-4968-8a64-ec06a6c537a3 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:21.084498 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7b9d9415-2a1f-4968-8a64-ec06a6c537a3 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:21.085256 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7b9d9415-2a1f-4968-8a64-ec06a6c537a3 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:21.085771 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7b9d9415-2a1f-4968-8a64-ec06a6c537a3 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:21.086262 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7b9d9415-2a1f-4968-8a64-ec06a6c537a3 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:21.222625 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-7b9d9415-2a1f-4968-8a64-ec06a6c537a3 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:21.230461 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-7b9d9415-2a1f-4968-8a64-ec06a6c537a3 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/1dc382df-229f-4a7a-9275-51eefdf4ee9a" status: 200 len: 1452 microversion: 2.1 time: 0.158144 Aug 09 02:46:21.231038 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 401/781] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:21 2022] GET /compute/v2.1/servers/1dc382df-229f-4a7a-9275-51eefdf4ee9a => generated 1452 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:46:21.598733 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-7a67a051-d311-4af3-bba9-023f67c29998 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:21.599514 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-7a67a051-d311-4af3-bba9-023f67c29998 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] [instance: 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:21.606368 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7a67a051-d311-4af3-bba9-023f67c29998 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:21.606937 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7a67a051-d311-4af3-bba9-023f67c29998 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:21.607351 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7a67a051-d311-4af3-bba9-023f67c29998 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:21.608041 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7a67a051-d311-4af3-bba9-023f67c29998 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:21.608485 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7a67a051-d311-4af3-bba9-023f67c29998 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:21.608904 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7a67a051-d311-4af3-bba9-023f67c29998 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:21.794055 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-7a67a051-d311-4af3-bba9-023f67c29998 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96475caac28419eb0b7dd78375e9e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5d24d2b8dc4844a48a76ed2ea2cffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:21.801673 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-7a67a051-d311-4af3-bba9-023f67c29998 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] 10.222.0.20 "GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b" status: 200 len: 1567 microversion: 2.1 time: 0.206840 Aug 09 02:46:21.802298 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 381/782] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:21 2022] GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b => generated 1567 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:46:22.825608 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-644489ab-83fe-4bd6-a35e-e1d1a2b4e2b7 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:22.826542 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-644489ab-83fe-4bd6-a35e-e1d1a2b4e2b7 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] [instance: 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:22.833802 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-644489ab-83fe-4bd6-a35e-e1d1a2b4e2b7 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:22.834412 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-644489ab-83fe-4bd6-a35e-e1d1a2b4e2b7 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:22.834811 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-644489ab-83fe-4bd6-a35e-e1d1a2b4e2b7 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:22.835884 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-644489ab-83fe-4bd6-a35e-e1d1a2b4e2b7 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:22.836338 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-644489ab-83fe-4bd6-a35e-e1d1a2b4e2b7 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:22.836760 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-644489ab-83fe-4bd6-a35e-e1d1a2b4e2b7 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:22.853099 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_cell1:SELECT=100 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:46:23.063263 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-644489ab-83fe-4bd6-a35e-e1d1a2b4e2b7 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96475caac28419eb0b7dd78375e9e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5d24d2b8dc4844a48a76ed2ea2cffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:23.071820 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-644489ab-83fe-4bd6-a35e-e1d1a2b4e2b7 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] 10.222.0.20 "GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b" status: 200 len: 1567 microversion: 2.1 time: 0.250902 Aug 09 02:46:23.072382 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 402/783] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:22 2022] GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b => generated 1567 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:46:23.288262 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [req-897d8ea0-b6a3-4600-bc4c-d3e1ed9c8ac5 req-1cf9bdd9-bcb8-49c1-af68-cec04d08b5fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1dc382df-229f-4a7a-9275-51eefdf4ee9a", "tag": "4340fc7a-b008-41f2-a681-5a15abc0d9ba"}]} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:46:23.305037 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-897d8ea0-b6a3-4600-bc4c-d3e1ed9c8ac5 req-1cf9bdd9-bcb8-49c1-af68-cec04d08b5fd service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:23.306122 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-897d8ea0-b6a3-4600-bc4c-d3e1ed9c8ac5 req-1cf9bdd9-bcb8-49c1-af68-cec04d08b5fd service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:23.306800 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-897d8ea0-b6a3-4600-bc4c-d3e1ed9c8ac5 req-1cf9bdd9-bcb8-49c1-af68-cec04d08b5fd service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:23.321543 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.compute.server_external_events [req-897d8ea0-b6a3-4600-bc4c-d3e1ed9c8ac5 req-1cf9bdd9-bcb8-49c1-af68-cec04d08b5fd service nova] Creating event network-changed:4340fc7a-b008-41f2-a681-5a15abc0d9ba for instance 1dc382df-229f-4a7a-9275-51eefdf4ee9a on hv-cinder-85246 Aug 09 02:46:23.328063 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [req-897d8ea0-b6a3-4600-bc4c-d3e1ed9c8ac5 req-1cf9bdd9-bcb8-49c1-af68-cec04d08b5fd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043449 Aug 09 02:46:23.329366 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 382/784] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:46:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:46:24.093304 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-aa2988bc-e7e0-4c25-911e-31ef942e6101 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:24.093948 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-aa2988bc-e7e0-4c25-911e-31ef942e6101 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] [instance: 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:24.101244 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-aa2988bc-e7e0-4c25-911e-31ef942e6101 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:24.101694 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-aa2988bc-e7e0-4c25-911e-31ef942e6101 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:24.102371 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-aa2988bc-e7e0-4c25-911e-31ef942e6101 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:24.103097 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-aa2988bc-e7e0-4c25-911e-31ef942e6101 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:24.103509 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-aa2988bc-e7e0-4c25-911e-31ef942e6101 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:24.104116 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-aa2988bc-e7e0-4c25-911e-31ef942e6101 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:24.246962 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-aa2988bc-e7e0-4c25-911e-31ef942e6101 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96475caac28419eb0b7dd78375e9e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5d24d2b8dc4844a48a76ed2ea2cffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:24.256584 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-aa2988bc-e7e0-4c25-911e-31ef942e6101 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] 10.222.0.20 "GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b" status: 200 len: 1567 microversion: 2.1 time: 0.167119 Aug 09 02:46:24.257804 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 403/785] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:24 2022] GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:46:25.280447 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-4199c679-a77a-40b2-81eb-9a8b4cf8ed75 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:25.281165 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-4199c679-a77a-40b2-81eb-9a8b4cf8ed75 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] [instance: 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:25.287444 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4199c679-a77a-40b2-81eb-9a8b4cf8ed75 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:25.288040 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4199c679-a77a-40b2-81eb-9a8b4cf8ed75 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:25.288481 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4199c679-a77a-40b2-81eb-9a8b4cf8ed75 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:25.289175 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4199c679-a77a-40b2-81eb-9a8b4cf8ed75 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:25.289636 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4199c679-a77a-40b2-81eb-9a8b4cf8ed75 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:25.290055 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4199c679-a77a-40b2-81eb-9a8b4cf8ed75 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:25.449055 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-4199c679-a77a-40b2-81eb-9a8b4cf8ed75 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96475caac28419eb0b7dd78375e9e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5d24d2b8dc4844a48a76ed2ea2cffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:25.456863 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-4199c679-a77a-40b2-81eb-9a8b4cf8ed75 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] 10.222.0.20 "GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b" status: 200 len: 1567 microversion: 2.1 time: 0.181188 Aug 09 02:46:25.457404 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 383/786] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:25 2022] GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b => generated 1567 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:46:26.478399 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-2ad35b32-16f6-4f73-ab0d-f2885694b64d tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:26.479010 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-2ad35b32-16f6-4f73-ab0d-f2885694b64d tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] [instance: 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:26.485947 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2ad35b32-16f6-4f73-ab0d-f2885694b64d tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:26.486752 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2ad35b32-16f6-4f73-ab0d-f2885694b64d tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:26.487198 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2ad35b32-16f6-4f73-ab0d-f2885694b64d tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:26.487875 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2ad35b32-16f6-4f73-ab0d-f2885694b64d tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:26.488314 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2ad35b32-16f6-4f73-ab0d-f2885694b64d tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:26.488726 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2ad35b32-16f6-4f73-ab0d-f2885694b64d tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:26.629347 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-2ad35b32-16f6-4f73-ab0d-f2885694b64d tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96475caac28419eb0b7dd78375e9e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5d24d2b8dc4844a48a76ed2ea2cffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:26.637243 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-2ad35b32-16f6-4f73-ab0d-f2885694b64d tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] 10.222.0.20 "GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b" status: 200 len: 1567 microversion: 2.1 time: 0.162887 Aug 09 02:46:26.637812 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 404/787] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:26 2022] GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:46:27.659607 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-703b1a8e-0675-4b1f-8204-acff4e30a7c0 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:27.660227 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-703b1a8e-0675-4b1f-8204-acff4e30a7c0 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] [instance: 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:27.667153 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-703b1a8e-0675-4b1f-8204-acff4e30a7c0 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:27.667643 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-703b1a8e-0675-4b1f-8204-acff4e30a7c0 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:27.668075 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-703b1a8e-0675-4b1f-8204-acff4e30a7c0 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:27.668779 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-703b1a8e-0675-4b1f-8204-acff4e30a7c0 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:27.669232 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-703b1a8e-0675-4b1f-8204-acff4e30a7c0 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:27.669654 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-703b1a8e-0675-4b1f-8204-acff4e30a7c0 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:27.814193 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-703b1a8e-0675-4b1f-8204-acff4e30a7c0 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96475caac28419eb0b7dd78375e9e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5d24d2b8dc4844a48a76ed2ea2cffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:27.822456 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-703b1a8e-0675-4b1f-8204-acff4e30a7c0 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] 10.222.0.20 "GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b" status: 200 len: 1567 microversion: 2.1 time: 0.166867 Aug 09 02:46:27.823067 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 384/788] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:27 2022] GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:46:27.924056 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-342c8e8d-deb2-4e62-9b15-a617aaaed56a tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:27.926415 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-342c8e8d-deb2-4e62-9b15-a617aaaed56a tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: ac4668e2-6e51-4087-bfca-a22cff3b147f] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:27.933403 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-342c8e8d-deb2-4e62-9b15-a617aaaed56a tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:27.933894 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-342c8e8d-deb2-4e62-9b15-a617aaaed56a tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:27.934373 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-342c8e8d-deb2-4e62-9b15-a617aaaed56a tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:27.935067 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-342c8e8d-deb2-4e62-9b15-a617aaaed56a tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:27.935518 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-342c8e8d-deb2-4e62-9b15-a617aaaed56a tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:27.935939 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-342c8e8d-deb2-4e62-9b15-a617aaaed56a tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:27.965606 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-342c8e8d-deb2-4e62-9b15-a617aaaed56a tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045626 Aug 09 02:46:27.966142 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 405/789] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 9 02:46:27 2022] GET /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:46:27.976884 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-f77b1f31-fbd4-4705-9bee-36e4658b16e1 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:27.977376 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-f77b1f31-fbd4-4705-9bee-36e4658b16e1 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: ac4668e2-6e51-4087-bfca-a22cff3b147f] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:27.983744 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f77b1f31-fbd4-4705-9bee-36e4658b16e1 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:27.984227 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f77b1f31-fbd4-4705-9bee-36e4658b16e1 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:27.984657 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f77b1f31-fbd4-4705-9bee-36e4658b16e1 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:27.985348 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f77b1f31-fbd4-4705-9bee-36e4658b16e1 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:27.985835 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f77b1f31-fbd4-4705-9bee-36e4658b16e1 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:27.986666 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f77b1f31-fbd4-4705-9bee-36e4658b16e1 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:28.015688 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-f77b1f31-fbd4-4705-9bee-36e4658b16e1 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f/os-volume_attachments/f39b529d-8d74-4efa-ae4c-6a7ca5183dae" status: 200 len: 194 microversion: 2.1 time: 0.042650 Aug 09 02:46:28.016244 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 385/790] 10.222.0.20 () {58 vars in 1413 bytes} [Tue Aug 9 02:46:27 2022] GET /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f/os-volume_attachments/f39b529d-8d74-4efa-ae4c-6a7ca5183dae => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:46:28.844079 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-68db9052-292d-4428-8384-8a5caff1c1e3 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:28.844697 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-68db9052-292d-4428-8384-8a5caff1c1e3 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] [instance: 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:28.850824 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-68db9052-292d-4428-8384-8a5caff1c1e3 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:28.851308 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-68db9052-292d-4428-8384-8a5caff1c1e3 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:28.851732 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-68db9052-292d-4428-8384-8a5caff1c1e3 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:28.852446 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-68db9052-292d-4428-8384-8a5caff1c1e3 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:28.852890 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-68db9052-292d-4428-8384-8a5caff1c1e3 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:28.853307 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-68db9052-292d-4428-8384-8a5caff1c1e3 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:29.002107 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-68db9052-292d-4428-8384-8a5caff1c1e3 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96475caac28419eb0b7dd78375e9e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5d24d2b8dc4844a48a76ed2ea2cffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:29.010143 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-68db9052-292d-4428-8384-8a5caff1c1e3 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] 10.222.0.20 "GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b" status: 200 len: 1567 microversion: 2.1 time: 0.170318 Aug 09 02:46:29.010735 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 406/791] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:28 2022] GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:46:29.360534 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-d633dffc-1fcf-49e5-bd90-c36b81146856 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc360c81-f7e4-409c-9b97-984f7cb64de4"}} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:46:29.363262 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-d633dffc-1fcf-49e5-bd90-c36b81146856 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: ac4668e2-6e51-4087-bfca-a22cff3b147f] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:29.370191 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d633dffc-1fcf-49e5-bd90-c36b81146856 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:29.370678 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d633dffc-1fcf-49e5-bd90-c36b81146856 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:29.371105 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d633dffc-1fcf-49e5-bd90-c36b81146856 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:29.371778 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d633dffc-1fcf-49e5-bd90-c36b81146856 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:29.372218 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d633dffc-1fcf-49e5-bd90-c36b81146856 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:29.372638 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d633dffc-1fcf-49e5-bd90-c36b81146856 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:29.679795 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-d633dffc-1fcf-49e5-bd90-c36b81146856 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "POST /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.323040 Aug 09 02:46:29.680468 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 386/792] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Aug 9 02:46:29 2022] POST /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f/os-volume_attachments => generated 194 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:46:30.035737 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-5fcf3a5e-cce6-4818-bd01-cb06a7fde02b tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:30.036606 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-5fcf3a5e-cce6-4818-bd01-cb06a7fde02b tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] [instance: 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:30.044355 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5fcf3a5e-cce6-4818-bd01-cb06a7fde02b tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:30.045267 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5fcf3a5e-cce6-4818-bd01-cb06a7fde02b tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:30.045267 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5fcf3a5e-cce6-4818-bd01-cb06a7fde02b tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:30.045902 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5fcf3a5e-cce6-4818-bd01-cb06a7fde02b tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:30.046370 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5fcf3a5e-cce6-4818-bd01-cb06a7fde02b tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:30.046783 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5fcf3a5e-cce6-4818-bd01-cb06a7fde02b tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:30.342257 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-5fcf3a5e-cce6-4818-bd01-cb06a7fde02b tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96475caac28419eb0b7dd78375e9e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5d24d2b8dc4844a48a76ed2ea2cffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:30.350886 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-5fcf3a5e-cce6-4818-bd01-cb06a7fde02b tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] 10.222.0.20 "GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b" status: 200 len: 1568 microversion: 2.1 time: 0.321873 Aug 09 02:46:30.351459 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 407/793] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:30 2022] GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b => generated 1568 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:46:30.372735 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-9ac69fde-c436-49fd-8dad-c5053b21d264 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:46:30.373415 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-9ac69fde-c436-49fd-8dad-c5053b21d264 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] [instance: 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:30.379903 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9ac69fde-c436-49fd-8dad-c5053b21d264 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:30.380559 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9ac69fde-c436-49fd-8dad-c5053b21d264 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:30.381129 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9ac69fde-c436-49fd-8dad-c5053b21d264 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:30.381875 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9ac69fde-c436-49fd-8dad-c5053b21d264 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:30.382410 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9ac69fde-c436-49fd-8dad-c5053b21d264 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:30.383028 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9ac69fde-c436-49fd-8dad-c5053b21d264 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:30.415090 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-9ac69fde-c436-49fd-8dad-c5053b21d264 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] [instance: 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124425) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 09 02:46:30.491494 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-9ac69fde-c436-49fd-8dad-c5053b21d264 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] 10.222.0.20 "POST /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b/action" status: 202 len: 0 microversion: 2.1 time: 0.123509 Aug 09 02:46:30.496776 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 387/794] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Aug 9 02:46:30 2022] POST /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 02:46:30.500552 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-c956d05f-3e28-4425-9c48-24486d091d1b tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:30.501156 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-c956d05f-3e28-4425-9c48-24486d091d1b tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] [instance: 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:30.510475 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-c956d05f-3e28-4425-9c48-24486d091d1b tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:30.511365 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-c956d05f-3e28-4425-9c48-24486d091d1b tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:30.512147 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-c956d05f-3e28-4425-9c48-24486d091d1b tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:30.513148 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-c956d05f-3e28-4425-9c48-24486d091d1b tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:30.514653 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-c956d05f-3e28-4425-9c48-24486d091d1b tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:30.514933 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-c956d05f-3e28-4425-9c48-24486d091d1b tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:30.679772 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-c956d05f-3e28-4425-9c48-24486d091d1b tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96475caac28419eb0b7dd78375e9e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5d24d2b8dc4844a48a76ed2ea2cffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:30.687691 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-c956d05f-3e28-4425-9c48-24486d091d1b tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] 10.222.0.20 "GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b" status: 200 len: 1516 microversion: 2.1 time: 0.191061 Aug 09 02:46:30.688267 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 408/795] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:30 2022] GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b => generated 1516 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:46:31.709382 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-8bcffbab-89f3-4e31-a051-dcf12ee2ab79 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:31.709949 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-8bcffbab-89f3-4e31-a051-dcf12ee2ab79 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] [instance: 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:31.717158 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8bcffbab-89f3-4e31-a051-dcf12ee2ab79 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:31.717639 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8bcffbab-89f3-4e31-a051-dcf12ee2ab79 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:31.718059 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8bcffbab-89f3-4e31-a051-dcf12ee2ab79 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:31.718794 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8bcffbab-89f3-4e31-a051-dcf12ee2ab79 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:31.719237 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8bcffbab-89f3-4e31-a051-dcf12ee2ab79 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:31.719645 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8bcffbab-89f3-4e31-a051-dcf12ee2ab79 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:31.865970 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-8bcffbab-89f3-4e31-a051-dcf12ee2ab79 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96475caac28419eb0b7dd78375e9e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5d24d2b8dc4844a48a76ed2ea2cffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:31.874071 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-8bcffbab-89f3-4e31-a051-dcf12ee2ab79 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] 10.222.0.20 "GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b" status: 200 len: 1518 microversion: 2.1 time: 0.168600 Aug 09 02:46:31.874678 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 388/796] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:31 2022] GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b => generated 1518 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:46:32.895413 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-5582a50e-fba6-423b-9c61-b95f96382f6f tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:32.896004 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-5582a50e-fba6-423b-9c61-b95f96382f6f tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] [instance: 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:32.902942 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5582a50e-fba6-423b-9c61-b95f96382f6f tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:32.903433 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5582a50e-fba6-423b-9c61-b95f96382f6f tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:32.903859 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5582a50e-fba6-423b-9c61-b95f96382f6f tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:32.904552 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5582a50e-fba6-423b-9c61-b95f96382f6f tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:32.905003 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5582a50e-fba6-423b-9c61-b95f96382f6f tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:32.905481 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5582a50e-fba6-423b-9c61-b95f96382f6f tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:33.044356 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-5582a50e-fba6-423b-9c61-b95f96382f6f tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96475caac28419eb0b7dd78375e9e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5d24d2b8dc4844a48a76ed2ea2cffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:33.051808 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-5582a50e-fba6-423b-9c61-b95f96382f6f tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] 10.222.0.20 "GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b" status: 200 len: 1518 microversion: 2.1 time: 0.160318 Aug 09 02:46:33.052368 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 409/797] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:32 2022] GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:46:33.939494 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [req-15566cd6-1212-4646-9b09-787fd0832eb7 req-eebfb72a-1e86-4178-b0eb-edcefdc9abeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b", "name": "network-vif-unplugged", "status": "completed", "tag": "f12d9ad9-133b-4098-a94d-fd5f540a9f7c"}]} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:46:33.951252 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-15566cd6-1212-4646-9b09-787fd0832eb7 req-eebfb72a-1e86-4178-b0eb-edcefdc9abeb service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:33.951760 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-15566cd6-1212-4646-9b09-787fd0832eb7 req-eebfb72a-1e86-4178-b0eb-edcefdc9abeb service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:33.952353 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-15566cd6-1212-4646-9b09-787fd0832eb7 req-eebfb72a-1e86-4178-b0eb-edcefdc9abeb service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:33.964460 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.compute.server_external_events [req-15566cd6-1212-4646-9b09-787fd0832eb7 req-eebfb72a-1e86-4178-b0eb-edcefdc9abeb service nova] Unable to find a host for instance 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b. Dropping event network-vif-unplugged {{(pid=124425) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 09 02:46:33.965350 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [req-15566cd6-1212-4646-9b09-787fd0832eb7 req-eebfb72a-1e86-4178-b0eb-edcefdc9abeb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029841 Aug 09 02:46:33.966033 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 389/798] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:46:33 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 09 02:46:34.073660 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-93bb0912-a2c5-414f-9349-44e399265275 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:34.074317 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-93bb0912-a2c5-414f-9349-44e399265275 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] [instance: 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:34.081528 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-93bb0912-a2c5-414f-9349-44e399265275 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:34.081975 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-93bb0912-a2c5-414f-9349-44e399265275 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:34.082522 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-93bb0912-a2c5-414f-9349-44e399265275 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:34.083231 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-93bb0912-a2c5-414f-9349-44e399265275 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:34.083686 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-93bb0912-a2c5-414f-9349-44e399265275 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:34.084110 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-93bb0912-a2c5-414f-9349-44e399265275 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:34.215754 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-93bb0912-a2c5-414f-9349-44e399265275 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96475caac28419eb0b7dd78375e9e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5d24d2b8dc4844a48a76ed2ea2cffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:34.223960 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-93bb0912-a2c5-414f-9349-44e399265275 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] 10.222.0.20 "GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b" status: 200 len: 1518 microversion: 2.1 time: 0.154895 Aug 09 02:46:34.224491 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 410/799] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:34 2022] GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:46:35.248758 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-c5a881e9-7473-4379-9a35-23bc348db599 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:35.250412 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-c5a881e9-7473-4379-9a35-23bc348db599 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] [instance: 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:35.257600 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c5a881e9-7473-4379-9a35-23bc348db599 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:35.258256 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c5a881e9-7473-4379-9a35-23bc348db599 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:35.258721 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c5a881e9-7473-4379-9a35-23bc348db599 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:35.259485 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c5a881e9-7473-4379-9a35-23bc348db599 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:35.260041 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c5a881e9-7473-4379-9a35-23bc348db599 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:35.260610 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c5a881e9-7473-4379-9a35-23bc348db599 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:35.396471 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-c5a881e9-7473-4379-9a35-23bc348db599 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96475caac28419eb0b7dd78375e9e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5d24d2b8dc4844a48a76ed2ea2cffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:35.415517 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-c5a881e9-7473-4379-9a35-23bc348db599 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] 10.222.0.20 "GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b" status: 200 len: 1518 microversion: 2.1 time: 0.160035 Aug 09 02:46:35.415517 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 390/800] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:35 2022] GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:46:36.426533 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-d345a8ce-25c2-45d9-a80d-0032ece872fe tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:36.427282 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-d345a8ce-25c2-45d9-a80d-0032ece872fe tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] [instance: 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:36.429384 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_api:SELECT=56 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:46:36.434865 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d345a8ce-25c2-45d9-a80d-0032ece872fe tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:36.435358 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d345a8ce-25c2-45d9-a80d-0032ece872fe tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:36.435784 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d345a8ce-25c2-45d9-a80d-0032ece872fe tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:36.436486 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d345a8ce-25c2-45d9-a80d-0032ece872fe tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:36.436937 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d345a8ce-25c2-45d9-a80d-0032ece872fe tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:36.437362 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d345a8ce-25c2-45d9-a80d-0032ece872fe tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:36.575567 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-d345a8ce-25c2-45d9-a80d-0032ece872fe tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96475caac28419eb0b7dd78375e9e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5d24d2b8dc4844a48a76ed2ea2cffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:36.583283 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-d345a8ce-25c2-45d9-a80d-0032ece872fe tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] 10.222.0.20 "GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b" status: 200 len: 1518 microversion: 2.1 time: 0.160876 Aug 09 02:46:36.583811 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 411/801] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:36 2022] GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:46:37.271330 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-f79659aa-570e-4248-863e-600e198ec82e tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:37.273754 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-f79659aa-570e-4248-863e-600e198ec82e tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: ac4668e2-6e51-4087-bfca-a22cff3b147f] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:37.280128 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f79659aa-570e-4248-863e-600e198ec82e tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:37.280650 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f79659aa-570e-4248-863e-600e198ec82e tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:37.281078 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f79659aa-570e-4248-863e-600e198ec82e tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:37.281772 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f79659aa-570e-4248-863e-600e198ec82e tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:37.282266 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f79659aa-570e-4248-863e-600e198ec82e tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:37.282838 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f79659aa-570e-4248-863e-600e198ec82e tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:37.309811 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-34a8aa87-1820-443e-9cfd-ad32546667b7 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:37.310521 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-34a8aa87-1820-443e-9cfd-ad32546667b7 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 1cc38775-2c7d-4558-8ca9-3a2ef4917949] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:37.312575 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-f79659aa-570e-4248-863e-600e198ec82e tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045408 Aug 09 02:46:37.318339 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 391/802] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 9 02:46:37 2022] GET /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:46:37.318515 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-34a8aa87-1820-443e-9cfd-ad32546667b7 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:37.318515 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-34a8aa87-1820-443e-9cfd-ad32546667b7 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:37.318515 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-34a8aa87-1820-443e-9cfd-ad32546667b7 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:37.319106 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-34a8aa87-1820-443e-9cfd-ad32546667b7 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:37.319577 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-34a8aa87-1820-443e-9cfd-ad32546667b7 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:37.320067 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-34a8aa87-1820-443e-9cfd-ad32546667b7 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:37.345426 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-34a8aa87-1820-443e-9cfd-ad32546667b7 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/1cc38775-2c7d-4558-8ca9-3a2ef4917949/ips" status: 200 len: 151 microversion: 2.1 time: 0.040175 Aug 09 02:46:37.345970 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 412/803] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Aug 9 02:46:37 2022] GET /compute/v2.1/servers/1cc38775-2c7d-4558-8ca9-3a2ef4917949/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 02:46:37.455519 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-c0f6cab1-00ff-4ed3-8dab-5314a31d7f11 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:37.456005 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-c0f6cab1-00ff-4ed3-8dab-5314a31d7f11 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: ac4668e2-6e51-4087-bfca-a22cff3b147f] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:37.462237 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c0f6cab1-00ff-4ed3-8dab-5314a31d7f11 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:37.462903 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c0f6cab1-00ff-4ed3-8dab-5314a31d7f11 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:37.463335 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c0f6cab1-00ff-4ed3-8dab-5314a31d7f11 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:37.464028 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c0f6cab1-00ff-4ed3-8dab-5314a31d7f11 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:37.464633 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c0f6cab1-00ff-4ed3-8dab-5314a31d7f11 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:37.465207 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c0f6cab1-00ff-4ed3-8dab-5314a31d7f11 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:37.494747 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-c0f6cab1-00ff-4ed3-8dab-5314a31d7f11 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f/os-volume_attachments/f39b529d-8d74-4efa-ae4c-6a7ca5183dae" status: 200 len: 194 microversion: 2.1 time: 0.043260 Aug 09 02:46:37.500672 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 392/804] 10.222.0.20 () {58 vars in 1413 bytes} [Tue Aug 9 02:46:37 2022] GET /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f/os-volume_attachments/f39b529d-8d74-4efa-ae4c-6a7ca5183dae => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:46:37.507108 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-88834c49-6ea0-40bf-b829-18ffd6739f40 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:37.507775 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-88834c49-6ea0-40bf-b829-18ffd6739f40 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: ac4668e2-6e51-4087-bfca-a22cff3b147f] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:37.515600 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-88834c49-6ea0-40bf-b829-18ffd6739f40 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:37.516097 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-88834c49-6ea0-40bf-b829-18ffd6739f40 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:37.516723 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-88834c49-6ea0-40bf-b829-18ffd6739f40 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:37.517521 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-88834c49-6ea0-40bf-b829-18ffd6739f40 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:37.517989 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-88834c49-6ea0-40bf-b829-18ffd6739f40 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:37.518456 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-88834c49-6ea0-40bf-b829-18ffd6739f40 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:37.606938 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-d55628f8-65ed-4c72-b703-fe8d2e3289d5 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:37.607872 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-d55628f8-65ed-4c72-b703-fe8d2e3289d5 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] [instance: 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:37.615296 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d55628f8-65ed-4c72-b703-fe8d2e3289d5 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:37.615817 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d55628f8-65ed-4c72-b703-fe8d2e3289d5 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:37.616336 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d55628f8-65ed-4c72-b703-fe8d2e3289d5 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:37.617054 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d55628f8-65ed-4c72-b703-fe8d2e3289d5 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:37.617576 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d55628f8-65ed-4c72-b703-fe8d2e3289d5 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:37.618073 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d55628f8-65ed-4c72-b703-fe8d2e3289d5 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:37.660303 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.objects.instance [None req-88834c49-6ea0-40bf-b829-18ffd6739f40 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lazy-loading 'services' on Instance uuid ac4668e2-6e51-4087-bfca-a22cff3b147f {{(pid=124427) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 02:46:37.796618 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-88834c49-6ea0-40bf-b829-18ffd6739f40 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f/os-volume_attachments/f39b529d-8d74-4efa-ae4c-6a7ca5183dae" status: 202 len: 0 microversion: 2.1 time: 0.293284 Aug 09 02:46:37.801751 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 413/805] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Aug 9 02:46:37 2022] DELETE /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f/os-volume_attachments/f39b529d-8d74-4efa-ae4c-6a7ca5183dae => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 02:46:37.853847 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-d55628f8-65ed-4c72-b703-fe8d2e3289d5 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96475caac28419eb0b7dd78375e9e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5d24d2b8dc4844a48a76ed2ea2cffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:37.862505 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-d55628f8-65ed-4c72-b703-fe8d2e3289d5 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] 10.222.0.20 "GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b" status: 200 len: 1518 microversion: 2.1 time: 0.262024 Aug 09 02:46:37.866926 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 393/806] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:37 2022] GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b => generated 1518 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:46:38.785993 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-0b26a65c-74e8-48da-8939-67181a544edc tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c511b1e4-c162-40b6-9892-a7cd1cc74fb7"}} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:46:38.789602 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-0b26a65c-74e8-48da-8939-67181a544edc tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 1cc38775-2c7d-4558-8ca9-3a2ef4917949] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:38.797513 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0b26a65c-74e8-48da-8939-67181a544edc tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:38.798013 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0b26a65c-74e8-48da-8939-67181a544edc tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:38.798471 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0b26a65c-74e8-48da-8939-67181a544edc tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:38.799172 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0b26a65c-74e8-48da-8939-67181a544edc tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:38.799622 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0b26a65c-74e8-48da-8939-67181a544edc tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:38.800043 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0b26a65c-74e8-48da-8939-67181a544edc tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:38.888079 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-0ffb28dc-81d7-4384-9eb4-363f3562e21d tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:38.888682 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-0ffb28dc-81d7-4384-9eb4-363f3562e21d tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] [instance: 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:38.895165 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0ffb28dc-81d7-4384-9eb4-363f3562e21d tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:38.895626 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0ffb28dc-81d7-4384-9eb4-363f3562e21d tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:38.896049 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0ffb28dc-81d7-4384-9eb4-363f3562e21d tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:38.896719 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0ffb28dc-81d7-4384-9eb4-363f3562e21d tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:38.897158 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0ffb28dc-81d7-4384-9eb4-363f3562e21d tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:38.897568 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0ffb28dc-81d7-4384-9eb4-363f3562e21d tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:39.041180 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-0ffb28dc-81d7-4384-9eb4-363f3562e21d tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96475caac28419eb0b7dd78375e9e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5d24d2b8dc4844a48a76ed2ea2cffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:39.050518 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-0ffb28dc-81d7-4384-9eb4-363f3562e21d tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] 10.222.0.20 "GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b" status: 200 len: 1574 microversion: 2.1 time: 0.166327 Aug 09 02:46:39.051106 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 394/807] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:38 2022] GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b => generated 1574 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:46:39.363408 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-0b26a65c-74e8-48da-8939-67181a544edc tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "POST /compute/v2.1/servers/1cc38775-2c7d-4558-8ca9-3a2ef4917949/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.584689 Aug 09 02:46:39.364391 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 414/808] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Aug 9 02:46:38 2022] POST /compute/v2.1/servers/1cc38775-2c7d-4558-8ca9-3a2ef4917949/os-volume_attachments => generated 194 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:46:40.005097 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-54c3c2bb-8f75-410d-8547-d2dd6fbcdccc tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:40.005598 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-54c3c2bb-8f75-410d-8547-d2dd6fbcdccc tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: ac4668e2-6e51-4087-bfca-a22cff3b147f] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:40.012667 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-54c3c2bb-8f75-410d-8547-d2dd6fbcdccc tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:40.013156 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-54c3c2bb-8f75-410d-8547-d2dd6fbcdccc tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:40.013665 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-54c3c2bb-8f75-410d-8547-d2dd6fbcdccc tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:40.014405 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-54c3c2bb-8f75-410d-8547-d2dd6fbcdccc tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:40.014864 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-54c3c2bb-8f75-410d-8547-d2dd6fbcdccc tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:40.015297 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-54c3c2bb-8f75-410d-8547-d2dd6fbcdccc tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:40.029285 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:46:40.046937 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-54c3c2bb-8f75-410d-8547-d2dd6fbcdccc tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f/os-volume_attachments/cc360c81-f7e4-409c-9b97-984f7cb64de4" status: 200 len: 194 microversion: 2.1 time: 0.046039 Aug 09 02:46:40.047517 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 395/809] 10.222.0.20 () {58 vars in 1413 bytes} [Tue Aug 9 02:46:39 2022] GET /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f/os-volume_attachments/cc360c81-f7e4-409c-9b97-984f7cb64de4 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:46:40.060458 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-3a6967bd-a605-4133-a8ff-68a31820f9e4 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:40.061044 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-3a6967bd-a605-4133-a8ff-68a31820f9e4 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: ac4668e2-6e51-4087-bfca-a22cff3b147f] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:40.067529 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3a6967bd-a605-4133-a8ff-68a31820f9e4 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:40.068017 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3a6967bd-a605-4133-a8ff-68a31820f9e4 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:40.068449 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3a6967bd-a605-4133-a8ff-68a31820f9e4 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:40.069137 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3a6967bd-a605-4133-a8ff-68a31820f9e4 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:40.069587 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3a6967bd-a605-4133-a8ff-68a31820f9e4 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:40.070004 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3a6967bd-a605-4133-a8ff-68a31820f9e4 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:40.071675 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-ff3b8bc0-5c5f-419b-a88a-191db04072c5 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:40.072287 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-ff3b8bc0-5c5f-419b-a88a-191db04072c5 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] [instance: 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:40.078358 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ff3b8bc0-5c5f-419b-a88a-191db04072c5 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:40.078835 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ff3b8bc0-5c5f-419b-a88a-191db04072c5 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:40.079265 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ff3b8bc0-5c5f-419b-a88a-191db04072c5 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:40.079952 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ff3b8bc0-5c5f-419b-a88a-191db04072c5 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:40.080418 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ff3b8bc0-5c5f-419b-a88a-191db04072c5 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:40.080821 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ff3b8bc0-5c5f-419b-a88a-191db04072c5 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:40.154896 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.objects.instance [None req-3a6967bd-a605-4133-a8ff-68a31820f9e4 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lazy-loading 'services' on Instance uuid ac4668e2-6e51-4087-bfca-a22cff3b147f {{(pid=124427) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 02:46:40.218557 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-ff3b8bc0-5c5f-419b-a88a-191db04072c5 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96475caac28419eb0b7dd78375e9e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5d24d2b8dc4844a48a76ed2ea2cffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:40.226161 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-ff3b8bc0-5c5f-419b-a88a-191db04072c5 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] 10.222.0.20 "GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b" status: 200 len: 1574 microversion: 2.1 time: 0.158422 Aug 09 02:46:40.226751 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 396/810] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:40 2022] GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:46:40.229205 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-3a6967bd-a605-4133-a8ff-68a31820f9e4 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f/os-volume_attachments/cc360c81-f7e4-409c-9b97-984f7cb64de4" status: 202 len: 0 microversion: 2.1 time: 0.174051 Aug 09 02:46:40.229781 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 415/811] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Aug 9 02:46:40 2022] DELETE /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f/os-volume_attachments/cc360c81-f7e4-409c-9b97-984f7cb64de4 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 02:46:41.251360 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-6817eb9b-2302-45ee-beea-a054c13da8cc tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:41.252360 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-6817eb9b-2302-45ee-beea-a054c13da8cc tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] [instance: 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:41.263087 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6817eb9b-2302-45ee-beea-a054c13da8cc tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:41.263666 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6817eb9b-2302-45ee-beea-a054c13da8cc tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:41.264403 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6817eb9b-2302-45ee-beea-a054c13da8cc tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:41.265354 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6817eb9b-2302-45ee-beea-a054c13da8cc tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:41.266040 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6817eb9b-2302-45ee-beea-a054c13da8cc tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:41.266702 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6817eb9b-2302-45ee-beea-a054c13da8cc tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:41.426297 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-6817eb9b-2302-45ee-beea-a054c13da8cc tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96475caac28419eb0b7dd78375e9e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5d24d2b8dc4844a48a76ed2ea2cffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:41.434130 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-6817eb9b-2302-45ee-beea-a054c13da8cc tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] 10.222.0.20 "GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b" status: 200 len: 1574 microversion: 2.1 time: 0.189254 Aug 09 02:46:41.434738 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 397/812] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:41 2022] GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b => generated 1574 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:46:42.457902 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-6e24ec67-3902-47fd-aa42-f7aedbacaf86 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:42.458638 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-6e24ec67-3902-47fd-aa42-f7aedbacaf86 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] [instance: 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:42.465450 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6e24ec67-3902-47fd-aa42-f7aedbacaf86 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:42.465924 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6e24ec67-3902-47fd-aa42-f7aedbacaf86 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:42.466545 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6e24ec67-3902-47fd-aa42-f7aedbacaf86 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:42.467238 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6e24ec67-3902-47fd-aa42-f7aedbacaf86 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:42.467685 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6e24ec67-3902-47fd-aa42-f7aedbacaf86 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:42.468107 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6e24ec67-3902-47fd-aa42-f7aedbacaf86 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:42.616945 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-6e24ec67-3902-47fd-aa42-f7aedbacaf86 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96475caac28419eb0b7dd78375e9e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5d24d2b8dc4844a48a76ed2ea2cffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:42.619297 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:46:42.625962 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-6e24ec67-3902-47fd-aa42-f7aedbacaf86 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] 10.222.0.20 "GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b" status: 200 len: 1574 microversion: 2.1 time: 0.173182 Aug 09 02:46:42.626554 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 416/813] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:42 2022] GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b => generated 1574 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:46:43.649520 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-76cad7e7-7e5b-4377-820d-62ae6eb9cd54 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:43.650141 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-76cad7e7-7e5b-4377-820d-62ae6eb9cd54 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] [instance: 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:43.657639 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-76cad7e7-7e5b-4377-820d-62ae6eb9cd54 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:43.658039 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-76cad7e7-7e5b-4377-820d-62ae6eb9cd54 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:43.658504 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-76cad7e7-7e5b-4377-820d-62ae6eb9cd54 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:43.659194 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-76cad7e7-7e5b-4377-820d-62ae6eb9cd54 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:43.659678 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-76cad7e7-7e5b-4377-820d-62ae6eb9cd54 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:43.660101 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-76cad7e7-7e5b-4377-820d-62ae6eb9cd54 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:43.804365 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-76cad7e7-7e5b-4377-820d-62ae6eb9cd54 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96475caac28419eb0b7dd78375e9e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5d24d2b8dc4844a48a76ed2ea2cffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:43.816808 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-76cad7e7-7e5b-4377-820d-62ae6eb9cd54 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] 10.222.0.20 "GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b" status: 200 len: 1574 microversion: 2.1 time: 0.171325 Aug 09 02:46:43.817514 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 398/814] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:43 2022] GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b => generated 1574 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:46:44.842754 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-add0eb7f-44b9-46db-bb8d-523ce79e703e tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:44.843777 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-add0eb7f-44b9-46db-bb8d-523ce79e703e tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] [instance: 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:44.853005 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-add0eb7f-44b9-46db-bb8d-523ce79e703e tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:44.853510 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-add0eb7f-44b9-46db-bb8d-523ce79e703e tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:44.853940 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-add0eb7f-44b9-46db-bb8d-523ce79e703e tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:44.854639 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-add0eb7f-44b9-46db-bb8d-523ce79e703e tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:44.855136 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-add0eb7f-44b9-46db-bb8d-523ce79e703e tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:44.855575 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-add0eb7f-44b9-46db-bb8d-523ce79e703e tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:44.988004 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-add0eb7f-44b9-46db-bb8d-523ce79e703e tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96475caac28419eb0b7dd78375e9e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5d24d2b8dc4844a48a76ed2ea2cffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:44.995725 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-add0eb7f-44b9-46db-bb8d-523ce79e703e tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] 10.222.0.20 "GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b" status: 200 len: 1574 microversion: 2.1 time: 0.160474 Aug 09 02:46:44.996292 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 417/815] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:44 2022] GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b => generated 1574 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:46:46.028703 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-5c5030c6-44ef-4925-a377-b3abea968bb8 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:46.029673 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-5c5030c6-44ef-4925-a377-b3abea968bb8 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] [instance: 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:46.039017 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-5c5030c6-44ef-4925-a377-b3abea968bb8 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:46.039495 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-5c5030c6-44ef-4925-a377-b3abea968bb8 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:46.039925 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-5c5030c6-44ef-4925-a377-b3abea968bb8 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:46.040606 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-5c5030c6-44ef-4925-a377-b3abea968bb8 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:46.041049 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-5c5030c6-44ef-4925-a377-b3abea968bb8 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:46.041468 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-5c5030c6-44ef-4925-a377-b3abea968bb8 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:46.184903 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-5c5030c6-44ef-4925-a377-b3abea968bb8 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96475caac28419eb0b7dd78375e9e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5d24d2b8dc4844a48a76ed2ea2cffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:46.192962 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-5c5030c6-44ef-4925-a377-b3abea968bb8 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] 10.222.0.20 "GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b" status: 200 len: 1574 microversion: 2.1 time: 0.170822 Aug 09 02:46:46.193539 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 399/816] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:46 2022] GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b => generated 1574 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:46:47.218420 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-df756be1-5f80-463e-a034-e9b53434f53d tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:47.219381 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-df756be1-5f80-463e-a034-e9b53434f53d tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] [instance: 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:47.230653 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-df756be1-5f80-463e-a034-e9b53434f53d tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:47.231454 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-df756be1-5f80-463e-a034-e9b53434f53d tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:47.232222 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-df756be1-5f80-463e-a034-e9b53434f53d tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:47.233383 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-df756be1-5f80-463e-a034-e9b53434f53d tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:47.234135 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-df756be1-5f80-463e-a034-e9b53434f53d tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:47.234880 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-df756be1-5f80-463e-a034-e9b53434f53d tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:47.372129 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-df756be1-5f80-463e-a034-e9b53434f53d tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96475caac28419eb0b7dd78375e9e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5d24d2b8dc4844a48a76ed2ea2cffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:47.379770 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-df756be1-5f80-463e-a034-e9b53434f53d tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] 10.222.0.20 "GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b" status: 200 len: 1574 microversion: 2.1 time: 0.167887 Aug 09 02:46:47.380308 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 418/817] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:47 2022] GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b => generated 1574 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:46:48.402058 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-d2dd569c-aa0d-48cd-a81d-a36c9cbb132e tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:48.403383 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-d2dd569c-aa0d-48cd-a81d-a36c9cbb132e tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] [instance: 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:48.407694 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:46:48.411278 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d2dd569c-aa0d-48cd-a81d-a36c9cbb132e tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:48.411966 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d2dd569c-aa0d-48cd-a81d-a36c9cbb132e tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:48.412590 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d2dd569c-aa0d-48cd-a81d-a36c9cbb132e tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:48.413512 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d2dd569c-aa0d-48cd-a81d-a36c9cbb132e tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:48.414125 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d2dd569c-aa0d-48cd-a81d-a36c9cbb132e tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:48.414865 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d2dd569c-aa0d-48cd-a81d-a36c9cbb132e tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:48.564624 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-d2dd569c-aa0d-48cd-a81d-a36c9cbb132e tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96475caac28419eb0b7dd78375e9e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5d24d2b8dc4844a48a76ed2ea2cffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:48.572785 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-d2dd569c-aa0d-48cd-a81d-a36c9cbb132e tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] 10.222.0.20 "GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b" status: 200 len: 1574 microversion: 2.1 time: 0.175674 Aug 09 02:46:48.573423 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 400/818] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:48 2022] GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b => generated 1574 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:46:49.594336 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-8de34edc-1aeb-4733-8d43-676202b08416 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:49.594943 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-8de34edc-1aeb-4733-8d43-676202b08416 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] [instance: 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:49.601403 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8de34edc-1aeb-4733-8d43-676202b08416 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:49.601878 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8de34edc-1aeb-4733-8d43-676202b08416 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:49.602331 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8de34edc-1aeb-4733-8d43-676202b08416 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:49.603023 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8de34edc-1aeb-4733-8d43-676202b08416 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:49.603457 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8de34edc-1aeb-4733-8d43-676202b08416 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:49.603869 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8de34edc-1aeb-4733-8d43-676202b08416 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:49.739239 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-8de34edc-1aeb-4733-8d43-676202b08416 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96475caac28419eb0b7dd78375e9e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5d24d2b8dc4844a48a76ed2ea2cffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:49.751641 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-8de34edc-1aeb-4733-8d43-676202b08416 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] 10.222.0.20 "GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b" status: 200 len: 1574 microversion: 2.1 time: 0.160905 Aug 09 02:46:49.752518 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 419/819] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:49 2022] GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:46:50.271089 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-ed6af291-ae55-44b5-8816-6ad429979427 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:50.271651 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-ed6af291-ae55-44b5-8816-6ad429979427 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 1cc38775-2c7d-4558-8ca9-3a2ef4917949] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:50.278139 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ed6af291-ae55-44b5-8816-6ad429979427 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:50.278643 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ed6af291-ae55-44b5-8816-6ad429979427 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:50.279068 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ed6af291-ae55-44b5-8816-6ad429979427 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:50.279748 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ed6af291-ae55-44b5-8816-6ad429979427 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:50.280188 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ed6af291-ae55-44b5-8816-6ad429979427 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:50.280583 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ed6af291-ae55-44b5-8816-6ad429979427 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:50.372737 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.objects.instance [None req-ed6af291-ae55-44b5-8816-6ad429979427 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lazy-loading 'services' on Instance uuid 1cc38775-2c7d-4558-8ca9-3a2ef4917949 {{(pid=124425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 02:46:50.448914 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-ed6af291-ae55-44b5-8816-6ad429979427 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1cc38775-2c7d-4558-8ca9-3a2ef4917949/os-volume_attachments/c511b1e4-c162-40b6-9892-a7cd1cc74fb7" status: 202 len: 0 microversion: 2.1 time: 0.181654 Aug 09 02:46:50.449531 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 401/820] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Aug 9 02:46:50 2022] DELETE /compute/v2.1/servers/1cc38775-2c7d-4558-8ca9-3a2ef4917949/os-volume_attachments/c511b1e4-c162-40b6-9892-a7cd1cc74fb7 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 02:46:50.458048 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-a1de9953-b7e0-41ec-9181-411fd1b3caca tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:50.460356 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-a1de9953-b7e0-41ec-9181-411fd1b3caca tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 1cc38775-2c7d-4558-8ca9-3a2ef4917949] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:50.466507 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a1de9953-b7e0-41ec-9181-411fd1b3caca tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:50.466957 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a1de9953-b7e0-41ec-9181-411fd1b3caca tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:50.467380 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a1de9953-b7e0-41ec-9181-411fd1b3caca tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:50.468054 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a1de9953-b7e0-41ec-9181-411fd1b3caca tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:50.468492 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a1de9953-b7e0-41ec-9181-411fd1b3caca tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:50.468903 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a1de9953-b7e0-41ec-9181-411fd1b3caca tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:50.498055 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-a1de9953-b7e0-41ec-9181-411fd1b3caca tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/1cc38775-2c7d-4558-8ca9-3a2ef4917949/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043979 Aug 09 02:46:50.498629 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 420/821] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 9 02:46:50 2022] GET /compute/v2.1/servers/1cc38775-2c7d-4558-8ca9-3a2ef4917949/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:46:50.780209 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-f1602c90-b9d8-47ef-b8ad-8477b4a9ff27 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:50.781592 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-f1602c90-b9d8-47ef-b8ad-8477b4a9ff27 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] [instance: 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:50.791135 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f1602c90-b9d8-47ef-b8ad-8477b4a9ff27 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:50.791604 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f1602c90-b9d8-47ef-b8ad-8477b4a9ff27 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:50.792036 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f1602c90-b9d8-47ef-b8ad-8477b4a9ff27 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:50.792723 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f1602c90-b9d8-47ef-b8ad-8477b4a9ff27 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:50.793177 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f1602c90-b9d8-47ef-b8ad-8477b4a9ff27 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:50.793593 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f1602c90-b9d8-47ef-b8ad-8477b4a9ff27 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:50.929201 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-f1602c90-b9d8-47ef-b8ad-8477b4a9ff27 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96475caac28419eb0b7dd78375e9e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5d24d2b8dc4844a48a76ed2ea2cffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:50.937061 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-f1602c90-b9d8-47ef-b8ad-8477b4a9ff27 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] 10.222.0.20 "GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b" status: 200 len: 1574 microversion: 2.1 time: 0.163877 Aug 09 02:46:50.937709 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 402/822] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:50 2022] GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b => generated 1574 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:46:51.511633 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-45eb6931-a7c5-4591-8d38-59cb8f5d1269 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:51.513826 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-45eb6931-a7c5-4591-8d38-59cb8f5d1269 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 1cc38775-2c7d-4558-8ca9-3a2ef4917949] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:51.520700 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-45eb6931-a7c5-4591-8d38-59cb8f5d1269 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:51.521183 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-45eb6931-a7c5-4591-8d38-59cb8f5d1269 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:51.521610 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-45eb6931-a7c5-4591-8d38-59cb8f5d1269 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:51.522373 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-45eb6931-a7c5-4591-8d38-59cb8f5d1269 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:51.522850 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-45eb6931-a7c5-4591-8d38-59cb8f5d1269 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:51.523267 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-45eb6931-a7c5-4591-8d38-59cb8f5d1269 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:51.552696 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-45eb6931-a7c5-4591-8d38-59cb8f5d1269 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/1cc38775-2c7d-4558-8ca9-3a2ef4917949/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045187 Aug 09 02:46:51.553525 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 421/823] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 9 02:46:51 2022] GET /compute/v2.1/servers/1cc38775-2c7d-4558-8ca9-3a2ef4917949/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:46:51.959672 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-d80e051c-7a8b-4b4f-9bab-a7e21dd94c36 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:51.960927 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-d80e051c-7a8b-4b4f-9bab-a7e21dd94c36 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] [instance: 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:51.969471 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d80e051c-7a8b-4b4f-9bab-a7e21dd94c36 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:51.970305 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d80e051c-7a8b-4b4f-9bab-a7e21dd94c36 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:51.970948 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d80e051c-7a8b-4b4f-9bab-a7e21dd94c36 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:51.971858 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d80e051c-7a8b-4b4f-9bab-a7e21dd94c36 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:51.972475 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d80e051c-7a8b-4b4f-9bab-a7e21dd94c36 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:51.972996 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d80e051c-7a8b-4b4f-9bab-a7e21dd94c36 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:52.120628 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-d80e051c-7a8b-4b4f-9bab-a7e21dd94c36 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96475caac28419eb0b7dd78375e9e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5d24d2b8dc4844a48a76ed2ea2cffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:52.128150 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-d80e051c-7a8b-4b4f-9bab-a7e21dd94c36 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] 10.222.0.20 "GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b" status: 200 len: 1574 microversion: 2.1 time: 0.173434 Aug 09 02:46:52.128743 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 403/824] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:51 2022] GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b => generated 1574 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:46:52.567693 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-f2036b69-cb4e-46c9-a942-7244b54600ab tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:52.570281 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-f2036b69-cb4e-46c9-a942-7244b54600ab tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 1cc38775-2c7d-4558-8ca9-3a2ef4917949] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:52.578884 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-f2036b69-cb4e-46c9-a942-7244b54600ab tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:52.579509 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-f2036b69-cb4e-46c9-a942-7244b54600ab tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:52.580141 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-f2036b69-cb4e-46c9-a942-7244b54600ab tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:52.581259 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-f2036b69-cb4e-46c9-a942-7244b54600ab tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:52.581848 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-f2036b69-cb4e-46c9-a942-7244b54600ab tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:52.582456 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-f2036b69-cb4e-46c9-a942-7244b54600ab tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:52.613229 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-f2036b69-cb4e-46c9-a942-7244b54600ab tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/1cc38775-2c7d-4558-8ca9-3a2ef4917949/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051248 Aug 09 02:46:52.613816 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 422/825] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 9 02:46:52 2022] GET /compute/v2.1/servers/1cc38775-2c7d-4558-8ca9-3a2ef4917949/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:46:53.134001 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-0620e64b-da12-497c-8dba-d2f0e45917c2 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:53.136280 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-0620e64b-da12-497c-8dba-d2f0e45917c2 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: ac4668e2-6e51-4087-bfca-a22cff3b147f] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:53.143141 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0620e64b-da12-497c-8dba-d2f0e45917c2 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:53.143629 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0620e64b-da12-497c-8dba-d2f0e45917c2 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:53.144065 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0620e64b-da12-497c-8dba-d2f0e45917c2 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:53.144765 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0620e64b-da12-497c-8dba-d2f0e45917c2 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:53.145223 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0620e64b-da12-497c-8dba-d2f0e45917c2 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:53.145654 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0620e64b-da12-497c-8dba-d2f0e45917c2 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:53.149753 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-f21ad3b4-3eba-495a-a58f-3a17f270a99a tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:53.150449 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-f21ad3b4-3eba-495a-a58f-3a17f270a99a tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] [instance: 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:53.156405 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-f21ad3b4-3eba-495a-a58f-3a17f270a99a tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:53.156885 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-f21ad3b4-3eba-495a-a58f-3a17f270a99a tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:53.157308 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-f21ad3b4-3eba-495a-a58f-3a17f270a99a tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:53.157984 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-f21ad3b4-3eba-495a-a58f-3a17f270a99a tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:53.158463 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-f21ad3b4-3eba-495a-a58f-3a17f270a99a tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:53.158875 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-f21ad3b4-3eba-495a-a58f-3a17f270a99a tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:53.175158 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-0620e64b-da12-497c-8dba-d2f0e45917c2 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045099 Aug 09 02:46:53.175720 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 404/826] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 9 02:46:53 2022] GET /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 02:46:53.305538 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-6622f7f4-63d8-42b8-b43e-3ba9d137dfea tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:53.308399 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-6622f7f4-63d8-42b8-b43e-3ba9d137dfea tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: ac4668e2-6e51-4087-bfca-a22cff3b147f] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:53.311141 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-f21ad3b4-3eba-495a-a58f-3a17f270a99a tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96475caac28419eb0b7dd78375e9e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5d24d2b8dc4844a48a76ed2ea2cffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:53.315009 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6622f7f4-63d8-42b8-b43e-3ba9d137dfea tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:53.315495 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6622f7f4-63d8-42b8-b43e-3ba9d137dfea tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:53.315928 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6622f7f4-63d8-42b8-b43e-3ba9d137dfea tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:53.316630 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6622f7f4-63d8-42b8-b43e-3ba9d137dfea tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:53.317081 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6622f7f4-63d8-42b8-b43e-3ba9d137dfea tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:53.317502 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6622f7f4-63d8-42b8-b43e-3ba9d137dfea tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:53.319444 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-f21ad3b4-3eba-495a-a58f-3a17f270a99a tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] 10.222.0.20 "GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b" status: 200 len: 1574 microversion: 2.1 time: 0.173819 Aug 09 02:46:53.320110 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 423/827] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:53 2022] GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b => generated 1574 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:46:53.346634 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-6622f7f4-63d8-42b8-b43e-3ba9d137dfea tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047789 Aug 09 02:46:53.347202 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 405/828] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 9 02:46:53 2022] GET /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 09 02:46:53.410519 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-a3763c5c-0ca1-4778-bc11-1688019c9e04 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:53.411007 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-a3763c5c-0ca1-4778-bc11-1688019c9e04 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: ac4668e2-6e51-4087-bfca-a22cff3b147f] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:53.417176 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a3763c5c-0ca1-4778-bc11-1688019c9e04 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:53.417661 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a3763c5c-0ca1-4778-bc11-1688019c9e04 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:53.418095 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a3763c5c-0ca1-4778-bc11-1688019c9e04 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:53.418835 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a3763c5c-0ca1-4778-bc11-1688019c9e04 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:53.419282 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a3763c5c-0ca1-4778-bc11-1688019c9e04 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:53.419705 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a3763c5c-0ca1-4778-bc11-1688019c9e04 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:53.444041 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-a3763c5c-0ca1-4778-bc11-1688019c9e04 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: ac4668e2-6e51-4087-bfca-a22cff3b147f] Going to try to terminate instance {{(pid=124427) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 02:46:53.521342 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-a3763c5c-0ca1-4778-bc11-1688019c9e04 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f" status: 204 len: 0 microversion: 2.1 time: 0.114385 Aug 09 02:46:53.521858 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 424/829] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 9 02:46:53 2022] DELETE /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 02:46:53.531079 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-06172591-904f-4507-9eea-4deb71cef02f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:53.531700 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-06172591-904f-4507-9eea-4deb71cef02f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: ac4668e2-6e51-4087-bfca-a22cff3b147f] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:53.537670 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-06172591-904f-4507-9eea-4deb71cef02f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:53.538177 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-06172591-904f-4507-9eea-4deb71cef02f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:53.538664 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-06172591-904f-4507-9eea-4deb71cef02f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:53.539347 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-06172591-904f-4507-9eea-4deb71cef02f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:53.539836 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-06172591-904f-4507-9eea-4deb71cef02f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:53.540259 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-06172591-904f-4507-9eea-4deb71cef02f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:53.626026 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-336e1e47-1090-42aa-85db-c8d9d557b42d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:53.628308 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-336e1e47-1090-42aa-85db-c8d9d557b42d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 1cc38775-2c7d-4558-8ca9-3a2ef4917949] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:53.635410 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-336e1e47-1090-42aa-85db-c8d9d557b42d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:53.635925 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-336e1e47-1090-42aa-85db-c8d9d557b42d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:53.636349 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-336e1e47-1090-42aa-85db-c8d9d557b42d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:53.637038 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-336e1e47-1090-42aa-85db-c8d9d557b42d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:53.637598 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-336e1e47-1090-42aa-85db-c8d9d557b42d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:53.638008 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-336e1e47-1090-42aa-85db-c8d9d557b42d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:53.667516 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-336e1e47-1090-42aa-85db-c8d9d557b42d tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/1cc38775-2c7d-4558-8ca9-3a2ef4917949/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045874 Aug 09 02:46:53.668076 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 425/830] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 9 02:46:53 2022] GET /compute/v2.1/servers/1cc38775-2c7d-4558-8ca9-3a2ef4917949/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 02:46:53.677493 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-06172591-904f-4507-9eea-4deb71cef02f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:53.685256 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-06172591-904f-4507-9eea-4deb71cef02f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f" status: 200 len: 1671 microversion: 2.1 time: 0.158149 Aug 09 02:46:53.685824 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 406/831] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:53 2022] GET /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f => generated 1671 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:46:53.729699 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-5278dafa-35dc-472f-8d87-26aa7aac5adc tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:53.730215 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-5278dafa-35dc-472f-8d87-26aa7aac5adc tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 1cc38775-2c7d-4558-8ca9-3a2ef4917949] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:53.736098 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5278dafa-35dc-472f-8d87-26aa7aac5adc tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:53.736568 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5278dafa-35dc-472f-8d87-26aa7aac5adc tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:53.737367 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5278dafa-35dc-472f-8d87-26aa7aac5adc tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:53.738036 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5278dafa-35dc-472f-8d87-26aa7aac5adc tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:53.738506 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5278dafa-35dc-472f-8d87-26aa7aac5adc tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:53.738922 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5278dafa-35dc-472f-8d87-26aa7aac5adc tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:53.763955 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-5278dafa-35dc-472f-8d87-26aa7aac5adc tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 1cc38775-2c7d-4558-8ca9-3a2ef4917949] Going to try to terminate instance {{(pid=124427) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 02:46:53.843109 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-5278dafa-35dc-472f-8d87-26aa7aac5adc tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1cc38775-2c7d-4558-8ca9-3a2ef4917949" status: 204 len: 0 microversion: 2.1 time: 0.117647 Aug 09 02:46:53.843695 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 426/832] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 9 02:46:53 2022] DELETE /compute/v2.1/servers/1cc38775-2c7d-4558-8ca9-3a2ef4917949 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 02:46:53.852252 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-28333216-9f16-4089-b93e-a159e069d6d6 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:53.853191 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-28333216-9f16-4089-b93e-a159e069d6d6 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 1cc38775-2c7d-4558-8ca9-3a2ef4917949] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:53.859887 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-28333216-9f16-4089-b93e-a159e069d6d6 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:53.860232 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-28333216-9f16-4089-b93e-a159e069d6d6 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:53.860681 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-28333216-9f16-4089-b93e-a159e069d6d6 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:53.861340 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-28333216-9f16-4089-b93e-a159e069d6d6 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:53.861791 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-28333216-9f16-4089-b93e-a159e069d6d6 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:53.862580 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-28333216-9f16-4089-b93e-a159e069d6d6 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:53.996209 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-28333216-9f16-4089-b93e-a159e069d6d6 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:54.003634 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-28333216-9f16-4089-b93e-a159e069d6d6 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/1cc38775-2c7d-4558-8ca9-3a2ef4917949" status: 200 len: 1682 microversion: 2.1 time: 0.155483 Aug 09 02:46:54.004198 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 407/833] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:53 2022] GET /compute/v2.1/servers/1cc38775-2c7d-4558-8ca9-3a2ef4917949 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:46:54.196808 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [req-4d5e387a-dc02-46c2-a8f8-ad0c25976689 req-f40002bd-ab35-4bb8-b8bd-2e034a5d9d31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b", "name": "network-vif-plugged", "status": "completed", "tag": "f12d9ad9-133b-4098-a94d-fd5f540a9f7c"}]} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:46:54.196808 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-4d5e387a-dc02-46c2-a8f8-ad0c25976689 req-f40002bd-ab35-4bb8-b8bd-2e034a5d9d31 service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:54.196808 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-4d5e387a-dc02-46c2-a8f8-ad0c25976689 req-f40002bd-ab35-4bb8-b8bd-2e034a5d9d31 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:54.196808 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-4d5e387a-dc02-46c2-a8f8-ad0c25976689 req-f40002bd-ab35-4bb8-b8bd-2e034a5d9d31 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:54.221539 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.compute.server_external_events [req-4d5e387a-dc02-46c2-a8f8-ad0c25976689 req-f40002bd-ab35-4bb8-b8bd-2e034a5d9d31 service nova] Creating event network-vif-plugged:f12d9ad9-133b-4098-a94d-fd5f540a9f7c for instance 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b on hv-cinder-85246 Aug 09 02:46:54.227349 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [req-4d5e387a-dc02-46c2-a8f8-ad0c25976689 req-f40002bd-ab35-4bb8-b8bd-2e034a5d9d31 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046432 Aug 09 02:46:54.228931 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 427/834] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:46:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:46:54.340150 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-477446d7-0c82-4b81-96b3-e43a39c9b065 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:54.340777 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-477446d7-0c82-4b81-96b3-e43a39c9b065 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] [instance: 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:54.347461 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-477446d7-0c82-4b81-96b3-e43a39c9b065 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:54.347941 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-477446d7-0c82-4b81-96b3-e43a39c9b065 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:54.348376 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-477446d7-0c82-4b81-96b3-e43a39c9b065 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:54.349062 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-477446d7-0c82-4b81-96b3-e43a39c9b065 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:54.349510 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-477446d7-0c82-4b81-96b3-e43a39c9b065 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:54.349927 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-477446d7-0c82-4b81-96b3-e43a39c9b065 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:54.489694 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-477446d7-0c82-4b81-96b3-e43a39c9b065 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96475caac28419eb0b7dd78375e9e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5d24d2b8dc4844a48a76ed2ea2cffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:54.497802 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-477446d7-0c82-4b81-96b3-e43a39c9b065 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] 10.222.0.20 "GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b" status: 200 len: 1574 microversion: 2.1 time: 0.161682 Aug 09 02:46:54.498421 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 408/835] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:54 2022] GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:46:54.708659 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-5cef2f6e-f30a-4c67-bd2d-781d64fb230d tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:54.709228 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-5cef2f6e-f30a-4c67-bd2d-781d64fb230d tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: ac4668e2-6e51-4087-bfca-a22cff3b147f] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:54.715938 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5cef2f6e-f30a-4c67-bd2d-781d64fb230d tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:54.716418 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5cef2f6e-f30a-4c67-bd2d-781d64fb230d tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:54.716848 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5cef2f6e-f30a-4c67-bd2d-781d64fb230d tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:54.717541 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5cef2f6e-f30a-4c67-bd2d-781d64fb230d tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:54.717999 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5cef2f6e-f30a-4c67-bd2d-781d64fb230d tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:54.718472 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5cef2f6e-f30a-4c67-bd2d-781d64fb230d tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:54.858351 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-5cef2f6e-f30a-4c67-bd2d-781d64fb230d tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:54.866256 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-5cef2f6e-f30a-4c67-bd2d-781d64fb230d tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f" status: 200 len: 1671 microversion: 2.1 time: 0.162463 Aug 09 02:46:54.866824 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 428/836] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:54 2022] GET /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f => generated 1671 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:46:55.029076 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-81e8aa95-bb57-4a18-afb5-6526e5e593cb tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:55.029963 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-81e8aa95-bb57-4a18-afb5-6526e5e593cb tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 1cc38775-2c7d-4558-8ca9-3a2ef4917949] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:55.040132 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-81e8aa95-bb57-4a18-afb5-6526e5e593cb tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:55.041070 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-81e8aa95-bb57-4a18-afb5-6526e5e593cb tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:55.041512 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-81e8aa95-bb57-4a18-afb5-6526e5e593cb tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:55.042268 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-81e8aa95-bb57-4a18-afb5-6526e5e593cb tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:55.042729 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-81e8aa95-bb57-4a18-afb5-6526e5e593cb tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:55.043148 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-81e8aa95-bb57-4a18-afb5-6526e5e593cb tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:55.183801 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-81e8aa95-bb57-4a18-afb5-6526e5e593cb tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:55.191881 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-81e8aa95-bb57-4a18-afb5-6526e5e593cb tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/1cc38775-2c7d-4558-8ca9-3a2ef4917949" status: 200 len: 1682 microversion: 2.1 time: 0.169517 Aug 09 02:46:55.192413 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 409/837] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:55 2022] GET /compute/v2.1/servers/1cc38775-2c7d-4558-8ca9-3a2ef4917949 => generated 1682 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:46:55.526699 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-773c2844-2f57-4734-83bd-35b88b147f43 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:55.527419 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-773c2844-2f57-4734-83bd-35b88b147f43 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] [instance: 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:55.533713 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-773c2844-2f57-4734-83bd-35b88b147f43 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:55.534129 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-773c2844-2f57-4734-83bd-35b88b147f43 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:55.534642 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-773c2844-2f57-4734-83bd-35b88b147f43 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:55.535337 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-773c2844-2f57-4734-83bd-35b88b147f43 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:55.535776 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-773c2844-2f57-4734-83bd-35b88b147f43 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:55.536198 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-773c2844-2f57-4734-83bd-35b88b147f43 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:55.671392 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-773c2844-2f57-4734-83bd-35b88b147f43 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96475caac28419eb0b7dd78375e9e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5d24d2b8dc4844a48a76ed2ea2cffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:55.682132 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-773c2844-2f57-4734-83bd-35b88b147f43 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] 10.222.0.20 "GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b" status: 200 len: 1574 microversion: 2.1 time: 0.159061 Aug 09 02:46:55.682920 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 429/838] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:55 2022] GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:46:55.891567 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-ff702b44-44a1-4f13-812e-5248fa99fa21 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:55.892607 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-ff702b44-44a1-4f13-812e-5248fa99fa21 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: ac4668e2-6e51-4087-bfca-a22cff3b147f] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:55.903658 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ff702b44-44a1-4f13-812e-5248fa99fa21 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:55.904450 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ff702b44-44a1-4f13-812e-5248fa99fa21 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:55.905172 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ff702b44-44a1-4f13-812e-5248fa99fa21 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:55.906398 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ff702b44-44a1-4f13-812e-5248fa99fa21 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:55.907189 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ff702b44-44a1-4f13-812e-5248fa99fa21 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:55.907931 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ff702b44-44a1-4f13-812e-5248fa99fa21 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:56.041015 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-ff702b44-44a1-4f13-812e-5248fa99fa21 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:56.048576 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-ff702b44-44a1-4f13-812e-5248fa99fa21 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f" status: 200 len: 1671 microversion: 2.1 time: 0.163685 Aug 09 02:46:56.049149 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 410/839] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:55 2022] GET /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f => generated 1671 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:46:56.225101 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-1a82b0f0-a2c7-4191-b07b-dabd8573cf35 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:56.225973 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-1a82b0f0-a2c7-4191-b07b-dabd8573cf35 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 1cc38775-2c7d-4558-8ca9-3a2ef4917949] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:56.236757 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1a82b0f0-a2c7-4191-b07b-dabd8573cf35 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:56.237933 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1a82b0f0-a2c7-4191-b07b-dabd8573cf35 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:56.238695 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1a82b0f0-a2c7-4191-b07b-dabd8573cf35 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:56.239813 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1a82b0f0-a2c7-4191-b07b-dabd8573cf35 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:56.240552 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1a82b0f0-a2c7-4191-b07b-dabd8573cf35 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:56.241242 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1a82b0f0-a2c7-4191-b07b-dabd8573cf35 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:56.377603 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-1a82b0f0-a2c7-4191-b07b-dabd8573cf35 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:56.379964 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:46:56.386577 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-1a82b0f0-a2c7-4191-b07b-dabd8573cf35 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/1cc38775-2c7d-4558-8ca9-3a2ef4917949" status: 200 len: 1682 microversion: 2.1 time: 0.168051 Aug 09 02:46:56.387150 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 430/840] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:56 2022] GET /compute/v2.1/servers/1cc38775-2c7d-4558-8ca9-3a2ef4917949 => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:46:56.713295 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-d134ecc1-f329-4842-9057-1953c81b80a2 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:56.714465 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-d134ecc1-f329-4842-9057-1953c81b80a2 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] [instance: 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:56.721432 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d134ecc1-f329-4842-9057-1953c81b80a2 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:56.721921 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d134ecc1-f329-4842-9057-1953c81b80a2 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:56.722384 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d134ecc1-f329-4842-9057-1953c81b80a2 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:56.723075 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d134ecc1-f329-4842-9057-1953c81b80a2 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:56.723521 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d134ecc1-f329-4842-9057-1953c81b80a2 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:56.723940 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d134ecc1-f329-4842-9057-1953c81b80a2 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:56.739183 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:46:56.877293 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-d134ecc1-f329-4842-9057-1953c81b80a2 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96475caac28419eb0b7dd78375e9e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5d24d2b8dc4844a48a76ed2ea2cffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:56.885824 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-d134ecc1-f329-4842-9057-1953c81b80a2 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] 10.222.0.20 "GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b" status: 200 len: 1574 microversion: 2.1 time: 0.179096 Aug 09 02:46:56.886435 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 411/841] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:56 2022] GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b => generated 1574 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:46:57.077247 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-b2e5c7d0-1cef-41a0-8b2a-3a105e65343f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:57.077869 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-b2e5c7d0-1cef-41a0-8b2a-3a105e65343f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: ac4668e2-6e51-4087-bfca-a22cff3b147f] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:57.084499 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b2e5c7d0-1cef-41a0-8b2a-3a105e65343f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:57.085027 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b2e5c7d0-1cef-41a0-8b2a-3a105e65343f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:57.085471 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b2e5c7d0-1cef-41a0-8b2a-3a105e65343f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:57.086130 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b2e5c7d0-1cef-41a0-8b2a-3a105e65343f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:57.086602 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b2e5c7d0-1cef-41a0-8b2a-3a105e65343f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:57.087003 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b2e5c7d0-1cef-41a0-8b2a-3a105e65343f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:57.221118 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-b2e5c7d0-1cef-41a0-8b2a-3a105e65343f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:57.229085 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-b2e5c7d0-1cef-41a0-8b2a-3a105e65343f tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f" status: 200 len: 1671 microversion: 2.1 time: 0.161427 Aug 09 02:46:57.229692 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 431/842] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:57 2022] GET /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f => generated 1671 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:46:57.412252 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-87a1bac4-3ff4-4ac5-923a-cb7925c1a16c tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:57.413454 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-87a1bac4-3ff4-4ac5-923a-cb7925c1a16c tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 1cc38775-2c7d-4558-8ca9-3a2ef4917949] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:57.422624 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-87a1bac4-3ff4-4ac5-923a-cb7925c1a16c tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:57.423136 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-87a1bac4-3ff4-4ac5-923a-cb7925c1a16c tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:57.423657 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-87a1bac4-3ff4-4ac5-923a-cb7925c1a16c tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:57.424422 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-87a1bac4-3ff4-4ac5-923a-cb7925c1a16c tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:57.424893 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-87a1bac4-3ff4-4ac5-923a-cb7925c1a16c tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:57.425309 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-87a1bac4-3ff4-4ac5-923a-cb7925c1a16c tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:57.558466 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-87a1bac4-3ff4-4ac5-923a-cb7925c1a16c tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:57.566263 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-87a1bac4-3ff4-4ac5-923a-cb7925c1a16c tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/1cc38775-2c7d-4558-8ca9-3a2ef4917949" status: 200 len: 1682 microversion: 2.1 time: 0.160677 Aug 09 02:46:57.566820 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 412/843] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:57 2022] GET /compute/v2.1/servers/1cc38775-2c7d-4558-8ca9-3a2ef4917949 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:46:57.910542 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-4b72b866-56ee-40b6-bc34-03d031ad28d0 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:57.911547 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-4b72b866-56ee-40b6-bc34-03d031ad28d0 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] [instance: 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:57.921347 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4b72b866-56ee-40b6-bc34-03d031ad28d0 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:57.921825 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4b72b866-56ee-40b6-bc34-03d031ad28d0 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:57.922298 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4b72b866-56ee-40b6-bc34-03d031ad28d0 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:57.922981 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4b72b866-56ee-40b6-bc34-03d031ad28d0 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:57.923422 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4b72b866-56ee-40b6-bc34-03d031ad28d0 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:57.923838 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4b72b866-56ee-40b6-bc34-03d031ad28d0 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:58.063268 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-4b72b866-56ee-40b6-bc34-03d031ad28d0 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96475caac28419eb0b7dd78375e9e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5d24d2b8dc4844a48a76ed2ea2cffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:58.071400 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-4b72b866-56ee-40b6-bc34-03d031ad28d0 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] 10.222.0.20 "GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b" status: 200 len: 1574 microversion: 2.1 time: 0.167368 Aug 09 02:46:58.071944 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 432/844] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:57 2022] GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b => generated 1574 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:46:58.255569 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-70c1dd11-8ea3-4627-9384-e005fa0900e2 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:58.256409 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-70c1dd11-8ea3-4627-9384-e005fa0900e2 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: ac4668e2-6e51-4087-bfca-a22cff3b147f] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:58.266513 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-70c1dd11-8ea3-4627-9384-e005fa0900e2 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:58.267318 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-70c1dd11-8ea3-4627-9384-e005fa0900e2 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:58.268041 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-70c1dd11-8ea3-4627-9384-e005fa0900e2 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:58.269179 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-70c1dd11-8ea3-4627-9384-e005fa0900e2 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:58.270013 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-70c1dd11-8ea3-4627-9384-e005fa0900e2 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:58.270789 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-70c1dd11-8ea3-4627-9384-e005fa0900e2 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:58.414867 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-70c1dd11-8ea3-4627-9384-e005fa0900e2 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:58.426529 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-70c1dd11-8ea3-4627-9384-e005fa0900e2 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f" status: 200 len: 1671 microversion: 2.1 time: 0.177414 Aug 09 02:46:58.427311 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 413/845] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:58 2022] GET /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f => generated 1671 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:46:58.587471 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-6c32af02-a4f1-436c-a200-24162dfafe90 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:58.588084 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-6c32af02-a4f1-436c-a200-24162dfafe90 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 1cc38775-2c7d-4558-8ca9-3a2ef4917949] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:58.594041 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6c32af02-a4f1-436c-a200-24162dfafe90 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:58.594550 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6c32af02-a4f1-436c-a200-24162dfafe90 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:58.594974 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6c32af02-a4f1-436c-a200-24162dfafe90 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:58.595828 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6c32af02-a4f1-436c-a200-24162dfafe90 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:58.596281 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6c32af02-a4f1-436c-a200-24162dfafe90 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:58.596711 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6c32af02-a4f1-436c-a200-24162dfafe90 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:58.730213 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-6c32af02-a4f1-436c-a200-24162dfafe90 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:58.738452 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-6c32af02-a4f1-436c-a200-24162dfafe90 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/1cc38775-2c7d-4558-8ca9-3a2ef4917949" status: 200 len: 1682 microversion: 2.1 time: 0.155049 Aug 09 02:46:58.739003 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 433/846] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:58 2022] GET /compute/v2.1/servers/1cc38775-2c7d-4558-8ca9-3a2ef4917949 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:46:59.092937 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-5148b644-e75b-42b1-abae-594ef467814c tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:59.093758 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-5148b644-e75b-42b1-abae-594ef467814c tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] [instance: 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:59.100135 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-5148b644-e75b-42b1-abae-594ef467814c tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:59.100688 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-5148b644-e75b-42b1-abae-594ef467814c tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:59.101185 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-5148b644-e75b-42b1-abae-594ef467814c tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:59.102130 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-5148b644-e75b-42b1-abae-594ef467814c tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:59.102682 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-5148b644-e75b-42b1-abae-594ef467814c tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:59.103172 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-5148b644-e75b-42b1-abae-594ef467814c tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:59.320013 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-5148b644-e75b-42b1-abae-594ef467814c tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96475caac28419eb0b7dd78375e9e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5d24d2b8dc4844a48a76ed2ea2cffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:59.327751 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-5148b644-e75b-42b1-abae-594ef467814c tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] 10.222.0.20 "GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b" status: 200 len: 1574 microversion: 2.1 time: 0.238944 Aug 09 02:46:59.328623 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 414/847] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:59 2022] GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b => generated 1574 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:46:59.452196 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-d36072ea-dfc8-47ff-9b41-7bc1d8e9e311 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:59.453466 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-d36072ea-dfc8-47ff-9b41-7bc1d8e9e311 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: ac4668e2-6e51-4087-bfca-a22cff3b147f] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:59.465007 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d36072ea-dfc8-47ff-9b41-7bc1d8e9e311 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:59.465849 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d36072ea-dfc8-47ff-9b41-7bc1d8e9e311 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:59.466685 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d36072ea-dfc8-47ff-9b41-7bc1d8e9e311 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:59.467912 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d36072ea-dfc8-47ff-9b41-7bc1d8e9e311 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:59.468594 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d36072ea-dfc8-47ff-9b41-7bc1d8e9e311 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:59.469268 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d36072ea-dfc8-47ff-9b41-7bc1d8e9e311 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:59.657269 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-d36072ea-dfc8-47ff-9b41-7bc1d8e9e311 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:46:59.666067 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-d36072ea-dfc8-47ff-9b41-7bc1d8e9e311 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f" status: 200 len: 1671 microversion: 2.1 time: 0.220307 Aug 09 02:46:59.666900 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 434/848] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:59 2022] GET /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f => generated 1671 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:46:59.765579 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-7232e5b4-2a83-4b85-85fc-e25dedc27775 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:46:59.767496 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-7232e5b4-2a83-4b85-85fc-e25dedc27775 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 1cc38775-2c7d-4558-8ca9-3a2ef4917949] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:46:59.768835 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [req-040a370b-fdd2-40e7-bd50-e74648d9583b req-45958d90-e5c9-4156-a85b-6600d47628eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cc38775-2c7d-4558-8ca9-3a2ef4917949", "name": "network-vif-deleted", "tag": "788bd99b-2ce6-4f25-9014-bd68dbaaa698"}]} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:46:59.776961 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7232e5b4-2a83-4b85-85fc-e25dedc27775 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:59.783479 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7232e5b4-2a83-4b85-85fc-e25dedc27775 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:59.784247 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7232e5b4-2a83-4b85-85fc-e25dedc27775 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:59.785196 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7232e5b4-2a83-4b85-85fc-e25dedc27775 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:59.785853 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7232e5b4-2a83-4b85-85fc-e25dedc27775 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:59.786548 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7232e5b4-2a83-4b85-85fc-e25dedc27775 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:59.800334 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-040a370b-fdd2-40e7-bd50-e74648d9583b req-45958d90-e5c9-4156-a85b-6600d47628eb service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:46:59.800911 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-040a370b-fdd2-40e7-bd50-e74648d9583b req-45958d90-e5c9-4156-a85b-6600d47628eb service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:46:59.801346 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-040a370b-fdd2-40e7-bd50-e74648d9583b req-45958d90-e5c9-4156-a85b-6600d47628eb service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:46:59.836546 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.compute.server_external_events [req-040a370b-fdd2-40e7-bd50-e74648d9583b req-45958d90-e5c9-4156-a85b-6600d47628eb service nova] Creating event network-vif-deleted:788bd99b-2ce6-4f25-9014-bd68dbaaa698 for instance 1cc38775-2c7d-4558-8ca9-3a2ef4917949 on hv-cinder-85246 Aug 09 02:46:59.849829 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [req-040a370b-fdd2-40e7-bd50-e74648d9583b req-45958d90-e5c9-4156-a85b-6600d47628eb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087341 Aug 09 02:46:59.851753 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 435/849] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:46:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:47:00.218574 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-7232e5b4-2a83-4b85-85fc-e25dedc27775 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43232b9b191047f9a3e6ebab7ad36f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce26c854fc24cadb2be5ebd441b8f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:00.232296 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-7232e5b4-2a83-4b85-85fc-e25dedc27775 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/1cc38775-2c7d-4558-8ca9-3a2ef4917949" status: 200 len: 1615 microversion: 2.1 time: 0.476784 Aug 09 02:47:00.232896 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 415/850] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:46:59 2022] GET /compute/v2.1/servers/1cc38775-2c7d-4558-8ca9-3a2ef4917949 => generated 1615 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:47:00.349074 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-03af1a29-3306-4a95-8110-b4dad56b52e6 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:00.349688 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-03af1a29-3306-4a95-8110-b4dad56b52e6 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] [instance: 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:47:00.354491 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-913e0bd3-f38e-4b53-a028-05e4b9bca743 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:00.355274 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-913e0bd3-f38e-4b53-a028-05e4b9bca743 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:47:00.364702 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-03af1a29-3306-4a95-8110-b4dad56b52e6 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:00.365192 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-03af1a29-3306-4a95-8110-b4dad56b52e6 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:00.365618 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-03af1a29-3306-4a95-8110-b4dad56b52e6 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:00.366895 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-913e0bd3-f38e-4b53-a028-05e4b9bca743 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:00.367363 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-913e0bd3-f38e-4b53-a028-05e4b9bca743 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:00.367747 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-03af1a29-3306-4a95-8110-b4dad56b52e6 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:00.368394 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-03af1a29-3306-4a95-8110-b4dad56b52e6 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:00.368811 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-03af1a29-3306-4a95-8110-b4dad56b52e6 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:00.371628 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-913e0bd3-f38e-4b53-a028-05e4b9bca743 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:00.372803 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-913e0bd3-f38e-4b53-a028-05e4b9bca743 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:00.373491 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-913e0bd3-f38e-4b53-a028-05e4b9bca743 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:00.373909 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-913e0bd3-f38e-4b53-a028-05e4b9bca743 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:00.401717 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-913e0bd3-f38e-4b53-a028-05e4b9bca743 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549/ips" status: 200 len: 149 microversion: 2.20 time: 0.060189 Aug 09 02:47:00.403619 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 436/851] 10.222.0.20 () {60 vars in 1289 bytes} [Tue Aug 9 02:47:00 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549/ips => generated 149 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 02:47:00.434437 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [req-d472ce4e-1030-4b2d-9bac-2d7844eaff1e req-42456c13-b99e-4cd2-af8c-f01dab74416e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac4668e2-6e51-4087-bfca-a22cff3b147f", "name": "network-vif-deleted", "tag": "134cb462-1c0a-49ec-94c5-16a7d99add24"}]} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:47:00.460509 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-d472ce4e-1030-4b2d-9bac-2d7844eaff1e req-42456c13-b99e-4cd2-af8c-f01dab74416e service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:00.461748 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-d472ce4e-1030-4b2d-9bac-2d7844eaff1e req-42456c13-b99e-4cd2-af8c-f01dab74416e service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:00.462601 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-d472ce4e-1030-4b2d-9bac-2d7844eaff1e req-42456c13-b99e-4cd2-af8c-f01dab74416e service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:00.479503 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.compute.server_external_events [req-d472ce4e-1030-4b2d-9bac-2d7844eaff1e req-42456c13-b99e-4cd2-af8c-f01dab74416e service nova] Creating event network-vif-deleted:134cb462-1c0a-49ec-94c5-16a7d99add24 for instance ac4668e2-6e51-4087-bfca-a22cff3b147f on hv-cinder-85246 Aug 09 02:47:00.487977 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [req-d472ce4e-1030-4b2d-9bac-2d7844eaff1e req-42456c13-b99e-4cd2-af8c-f01dab74416e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082002 Aug 09 02:47:00.488823 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 437/852] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:47:00.534739 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-03af1a29-3306-4a95-8110-b4dad56b52e6 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96475caac28419eb0b7dd78375e9e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5d24d2b8dc4844a48a76ed2ea2cffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:00.544134 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-03af1a29-3306-4a95-8110-b4dad56b52e6 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] 10.222.0.20 "GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b" status: 200 len: 1561 microversion: 2.1 time: 0.198978 Aug 09 02:47:00.545684 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 416/853] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:47:00 2022] GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b => generated 1561 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:47:00.691380 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-9a970b00-853b-4ace-9071-db600085847c tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:00.692101 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-9a970b00-853b-4ace-9071-db600085847c tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: ac4668e2-6e51-4087-bfca-a22cff3b147f] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:47:00.698355 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9a970b00-853b-4ace-9071-db600085847c tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:00.699096 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9a970b00-853b-4ace-9071-db600085847c tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:00.699774 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9a970b00-853b-4ace-9071-db600085847c tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:00.700711 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9a970b00-853b-4ace-9071-db600085847c tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:00.701429 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9a970b00-853b-4ace-9071-db600085847c tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:00.702084 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9a970b00-853b-4ace-9071-db600085847c tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:00.802459 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-9a970b00-853b-4ace-9071-db600085847c tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aaa8a7f386e4ccc9ab5c356cdf1704f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467b42c2bec74fcbbf90d007a6e00096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:00.813537 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-9a970b00-853b-4ace-9071-db600085847c tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f" status: 200 len: 1604 microversion: 2.1 time: 0.124297 Aug 09 02:47:00.815205 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 438/854] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:47:00 2022] GET /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f => generated 1604 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:47:01.254235 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-b8796f2a-06c8-4a67-8eca-7b20979f0036 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:01.255591 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-b8796f2a-06c8-4a67-8eca-7b20979f0036 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 1cc38775-2c7d-4558-8ca9-3a2ef4917949] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:47:01.266746 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b8796f2a-06c8-4a67-8eca-7b20979f0036 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:01.267244 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b8796f2a-06c8-4a67-8eca-7b20979f0036 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:01.267683 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b8796f2a-06c8-4a67-8eca-7b20979f0036 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:01.268562 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b8796f2a-06c8-4a67-8eca-7b20979f0036 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:01.269002 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b8796f2a-06c8-4a67-8eca-7b20979f0036 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:01.269404 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b8796f2a-06c8-4a67-8eca-7b20979f0036 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:01.284518 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.wsgi [None req-b8796f2a-06c8-4a67-8eca-7b20979f0036 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] HTTP exception thrown: Instance 1cc38775-2c7d-4558-8ca9-3a2ef4917949 could not be found. Aug 09 02:47:01.286214 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-b8796f2a-06c8-4a67-8eca-7b20979f0036 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Request method failure captured: Aug 09 02:47:01.286214 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: request: GET /compute/v2.1/servers/1cc38775-2c7d-4558-8ca9-3a2ef4917949 HTTP/1.1 Aug 09 02:47:01.286214 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Accept: application/json Aug 09 02:47:01.286214 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Accept-Encoding: identity Aug 09 02:47:01.286214 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Connection: close Aug 09 02:47:01.286214 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Content-Length: 0 Aug 09 02:47:01.286214 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Content-Type: application/json Aug 09 02:47:01.286214 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Host: 10.222.0.20 Aug 09 02:47:01.286214 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Openstack-System-Scope: None Aug 09 02:47:01.286214 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: User-Agent: python-urllib3/1.26.11 Aug 09 02:47:01.286214 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Auth-Token: gAAAAABi8ckjyQvMSPVjOXRhh70Rnc1ANMFv7G7JLArfSACfDLzvvcneDlsL-sI9hF681zwEIODxGFE7k1OsPJO-SGVxluvBNMmaFLG_fx-H9D1ZvGPLVeuDO_toy5qwJovkKz9pwj7m5cniNs8yMlVJKkLfQNx_gl4pQZFRtesItHh6k1DiYvw Aug 09 02:47:01.286214 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Domain-Id: None Aug 09 02:47:01.286214 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Domain-Name: None Aug 09 02:47:01.286214 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Identity-Status: Confirmed Aug 09 02:47:01.286214 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Is-Admin-Project: True Aug 09 02:47:01.286214 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Domain-Id: default Aug 09 02:47:01.286214 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Domain-Name: Default Aug 09 02:47:01.286214 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Id: 8ce26c854fc24cadb2be5ebd441b8f3a Aug 09 02:47:01.286214 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Name: tempest-AttachVolumeNegativeTest-1568455203 Aug 09 02:47:01.286214 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Role: reader,member Aug 09 02:47:01.286214 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Roles: reader,member Aug 09 02:47:01.287967 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8ce26c854fc24cadb2be5ebd441b8f3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8ce26c854fc24cadb2be5ebd441b8f3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8ce26c854fc24cadb2be5ebd441b8f3a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8ce26c854fc24cadb2be5ebd441b8f3a"}]}] Aug 09 02:47:01.287967 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant: tempest-AttachVolumeNegativeTest-1568455203 Aug 09 02:47:01.287967 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant-Id: 8ce26c854fc24cadb2be5ebd441b8f3a Aug 09 02:47:01.287967 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1568455203 Aug 09 02:47:01.287967 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User: tempest-AttachVolumeNegativeTest-1568455203-project Aug 09 02:47:01.287967 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Domain-Id: default Aug 09 02:47:01.287967 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Domain-Name: Default Aug 09 02:47:01.287967 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Id: 43232b9b191047f9a3e6ebab7ad36f02 Aug 09 02:47:01.287967 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Name: tempest-AttachVolumeNegativeTest-1568455203-project Aug 09 02:47:01.287967 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: method: > Aug 09 02:47:01.287967 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: exception: Instance 1cc38775-2c7d-4558-8ca9-3a2ef4917949 could not be found. Aug 09 02:47:01.287967 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: action_args: {'id': '1cc38775-2c7d-4558-8ca9-3a2ef4917949'} Aug 09 02:47:01.289024 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 02:47:01.289024 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:01.289024 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 02:47:01.289024 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 02:47:01.289024 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 02:47:01.289024 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 02:47:01.289024 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 02:47:01.289024 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 02:47:01.289024 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 02:47:01.289024 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 02:47:01.289024 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cc38775-2c7d-4558-8ca9-3a2ef4917949 could not be found. Aug 09 02:47:01.289024 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:47:01.289024 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:47:01.289024 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:47:01.289024 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:01.289024 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:47:01.289024 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:47:01.289024 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 02:47:01.289024 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 02:47:01.289024 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 02:47:01.290398 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 02:47:01.290398 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 02:47:01.290398 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 02:47:01.290398 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 02:47:01.290398 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 02:47:01.290398 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 02:47:01.290398 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 02:47:01.290398 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cc38775-2c7d-4558-8ca9-3a2ef4917949 could not be found. Aug 09 02:47:01.290398 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:47:01.290398 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:47:01.290398 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:47:01.290398 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:01.290398 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:47:01.290398 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:47:01.290398 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 02:47:01.290398 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 02:47:01.290398 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cc38775-2c7d-4558-8ca9-3a2ef4917949 could not be found. Aug 09 02:47:01.290398 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:47:01.291646 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-b8796f2a-06c8-4a67-8eca-7b20979f0036 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Returning 404 to user: Instance 1cc38775-2c7d-4558-8ca9-3a2ef4917949 could not be found. {{(pid=124425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 02:47:01.291646 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-b8796f2a-06c8-4a67-8eca-7b20979f0036 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/1cc38775-2c7d-4558-8ca9-3a2ef4917949" status: 404 len: 111 microversion: 2.1 time: 0.037640 Aug 09 02:47:01.291646 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 417/855] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:47:01 2022] GET /compute/v2.1/servers/1cc38775-2c7d-4558-8ca9-3a2ef4917949 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 02:47:01.297210 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-6ea8a768-a9dc-4f7c-b4d5-aa6be62f8fd6 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '.version_select at 0x7fb0a02d55e0>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:01.319101 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-6ea8a768-a9dc-4f7c-b4d5-aa6be62f8fd6 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1007592254" status: 202 len: 0 microversion: 2.1 time: 0.025867 Aug 09 02:47:01.320205 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 439/856] 10.222.0.20 () {58 vars in 1221 bytes} [Tue Aug 9 02:47:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1007592254 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 02:47:01.842444 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-6e9345f7-0054-473e-9dc0-c2b5e1df9e11 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:01.843336 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-6e9345f7-0054-473e-9dc0-c2b5e1df9e11 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: ac4668e2-6e51-4087-bfca-a22cff3b147f] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:47:01.850030 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6e9345f7-0054-473e-9dc0-c2b5e1df9e11 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:01.850585 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6e9345f7-0054-473e-9dc0-c2b5e1df9e11 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:01.851249 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6e9345f7-0054-473e-9dc0-c2b5e1df9e11 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:01.851949 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6e9345f7-0054-473e-9dc0-c2b5e1df9e11 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:01.852387 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6e9345f7-0054-473e-9dc0-c2b5e1df9e11 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:01.852827 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6e9345f7-0054-473e-9dc0-c2b5e1df9e11 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:01.867595 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.wsgi [None req-6e9345f7-0054-473e-9dc0-c2b5e1df9e11 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] HTTP exception thrown: Instance ac4668e2-6e51-4087-bfca-a22cff3b147f could not be found. Aug 09 02:47:01.869132 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-6e9345f7-0054-473e-9dc0-c2b5e1df9e11 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Request method failure captured: Aug 09 02:47:01.869132 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: request: GET /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f HTTP/1.1 Aug 09 02:47:01.869132 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Accept: application/json Aug 09 02:47:01.869132 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Accept-Encoding: identity Aug 09 02:47:01.869132 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Connection: close Aug 09 02:47:01.869132 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Content-Length: 0 Aug 09 02:47:01.869132 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Content-Type: application/json Aug 09 02:47:01.869132 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Host: 10.222.0.20 Aug 09 02:47:01.869132 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Openstack-System-Scope: None Aug 09 02:47:01.869132 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: User-Agent: python-urllib3/1.26.11 Aug 09 02:47:01.869132 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Auth-Token: gAAAAABi8ckyQ7BoJhOISZ_aEyRwvtOf6wBg9xUi9Vu7KodpYSACalrsvz2rvL1C_mIOt-qr3Bi3jUgZqn7iqf0560XT8zZG6jy4ZTCN9qg5QZL2v5rqXFvpy1e6ziUjE1jR1eQoZ7H0yZm_ukrqaTXnceGFTdwFzKa-RsIlRVyuWjAiXqqozsE Aug 09 02:47:01.869132 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Domain-Id: None Aug 09 02:47:01.869132 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Domain-Name: None Aug 09 02:47:01.869132 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Identity-Status: Confirmed Aug 09 02:47:01.869132 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Is-Admin-Project: True Aug 09 02:47:01.869132 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Domain-Id: default Aug 09 02:47:01.869132 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Domain-Name: Default Aug 09 02:47:01.869132 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Id: 467b42c2bec74fcbbf90d007a6e00096 Aug 09 02:47:01.869132 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Name: tempest-AttachVolumeTestJSON-1583791890 Aug 09 02:47:01.869132 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Role: reader,member Aug 09 02:47:01.869132 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Roles: reader,member Aug 09 02:47:01.870649 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/467b42c2bec74fcbbf90d007a6e00096"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/467b42c2bec74fcbbf90d007a6e00096"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_467b42c2bec74fcbbf90d007a6e00096"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/467b42c2bec74fcbbf90d007a6e00096"}]}] Aug 09 02:47:01.870649 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant: tempest-AttachVolumeTestJSON-1583791890 Aug 09 02:47:01.870649 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant-Id: 467b42c2bec74fcbbf90d007a6e00096 Aug 09 02:47:01.870649 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1583791890 Aug 09 02:47:01.870649 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User: tempest-AttachVolumeTestJSON-1583791890-project Aug 09 02:47:01.870649 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Domain-Id: default Aug 09 02:47:01.870649 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Domain-Name: Default Aug 09 02:47:01.870649 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Id: 2aaa8a7f386e4ccc9ab5c356cdf1704f Aug 09 02:47:01.870649 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Name: tempest-AttachVolumeTestJSON-1583791890-project Aug 09 02:47:01.870649 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: method: > Aug 09 02:47:01.870649 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: exception: Instance ac4668e2-6e51-4087-bfca-a22cff3b147f could not be found. Aug 09 02:47:01.870649 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: action_args: {'id': 'ac4668e2-6e51-4087-bfca-a22cff3b147f'} Aug 09 02:47:01.871542 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 02:47:01.871542 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:01.871542 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 02:47:01.871542 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 02:47:01.871542 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 02:47:01.871542 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 02:47:01.871542 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 02:47:01.871542 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 02:47:01.871542 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 02:47:01.871542 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 02:47:01.871542 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac4668e2-6e51-4087-bfca-a22cff3b147f could not be found. Aug 09 02:47:01.871542 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:47:01.871542 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:47:01.871542 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:47:01.871542 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:01.871542 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:47:01.871542 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:47:01.871542 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 02:47:01.871542 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 02:47:01.871542 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 02:47:01.873075 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 02:47:01.873075 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 02:47:01.873075 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 02:47:01.873075 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 02:47:01.873075 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 02:47:01.873075 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 02:47:01.873075 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 02:47:01.873075 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac4668e2-6e51-4087-bfca-a22cff3b147f could not be found. Aug 09 02:47:01.873075 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:47:01.873075 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:47:01.873075 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:47:01.873075 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:01.873075 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:47:01.873075 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:47:01.873075 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 02:47:01.873075 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 02:47:01.873075 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac4668e2-6e51-4087-bfca-a22cff3b147f could not be found. Aug 09 02:47:01.873075 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:47:01.874801 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-6e9345f7-0054-473e-9dc0-c2b5e1df9e11 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Returning 404 to user: Instance ac4668e2-6e51-4087-bfca-a22cff3b147f could not be found. {{(pid=124425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 02:47:01.874801 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-6e9345f7-0054-473e-9dc0-c2b5e1df9e11 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f" status: 404 len: 111 microversion: 2.1 time: 0.032910 Aug 09 02:47:01.874801 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 418/857] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:47:01 2022] GET /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 02:47:01.880164 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-fef41b44-ae97-4aad-a198-a044001ff88d tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '.version_select at 0x7fb0a02283a0>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:01.901626 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-fef41b44-ae97-4aad-a198-a044001ff88d tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-433822673" status: 202 len: 0 microversion: 2.1 time: 0.025932 Aug 09 02:47:01.902407 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 440/858] 10.222.0.20 () {58 vars in 1218 bytes} [Tue Aug 9 02:47:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-433822673 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 02:47:03.019475 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-6ed79783-166f-4c34-a3ca-5e5270dbae27 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:47:03.020695 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-6ed79783-166f-4c34-a3ca-5e5270dbae27 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:47:03.027480 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6ed79783-166f-4c34-a3ca-5e5270dbae27 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:03.028000 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6ed79783-166f-4c34-a3ca-5e5270dbae27 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:03.028482 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6ed79783-166f-4c34-a3ca-5e5270dbae27 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:03.029180 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6ed79783-166f-4c34-a3ca-5e5270dbae27 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:03.029660 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6ed79783-166f-4c34-a3ca-5e5270dbae27 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:03.030105 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6ed79783-166f-4c34-a3ca-5e5270dbae27 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:03.058257 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.objects.instance [None req-6ed79783-166f-4c34-a3ca-5e5270dbae27 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lazy-loading 'flavor' on Instance uuid 01aef713-9cfa-4840-829f-b5d30b2f9549 {{(pid=124425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 02:47:03.174465 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-d2411084-4510-412d-addf-833207af2ba0 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:03.175045 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-d2411084-4510-412d-addf-833207af2ba0 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 1cc38775-2c7d-4558-8ca9-3a2ef4917949] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:47:03.181522 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d2411084-4510-412d-addf-833207af2ba0 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:03.182085 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d2411084-4510-412d-addf-833207af2ba0 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:03.182733 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d2411084-4510-412d-addf-833207af2ba0 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:03.183497 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d2411084-4510-412d-addf-833207af2ba0 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:03.184029 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d2411084-4510-412d-addf-833207af2ba0 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:03.184518 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d2411084-4510-412d-addf-833207af2ba0 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:03.199026 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.wsgi [None req-d2411084-4510-412d-addf-833207af2ba0 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] HTTP exception thrown: Instance 1cc38775-2c7d-4558-8ca9-3a2ef4917949 could not be found. Aug 09 02:47:03.200783 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-d2411084-4510-412d-addf-833207af2ba0 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Request method failure captured: Aug 09 02:47:03.200783 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: request: DELETE /compute/v2.1/servers/1cc38775-2c7d-4558-8ca9-3a2ef4917949 HTTP/1.1 Aug 09 02:47:03.200783 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Accept: application/json Aug 09 02:47:03.200783 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Accept-Encoding: identity Aug 09 02:47:03.200783 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Connection: close Aug 09 02:47:03.200783 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Content-Length: 0 Aug 09 02:47:03.200783 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Content-Type: application/json Aug 09 02:47:03.200783 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Host: 10.222.0.20 Aug 09 02:47:03.200783 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Openstack-System-Scope: None Aug 09 02:47:03.200783 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: User-Agent: python-urllib3/1.26.11 Aug 09 02:47:03.200783 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Auth-Token: gAAAAABi8ckjyQvMSPVjOXRhh70Rnc1ANMFv7G7JLArfSACfDLzvvcneDlsL-sI9hF681zwEIODxGFE7k1OsPJO-SGVxluvBNMmaFLG_fx-H9D1ZvGPLVeuDO_toy5qwJovkKz9pwj7m5cniNs8yMlVJKkLfQNx_gl4pQZFRtesItHh6k1DiYvw Aug 09 02:47:03.200783 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Domain-Id: None Aug 09 02:47:03.200783 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Domain-Name: None Aug 09 02:47:03.200783 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Identity-Status: Confirmed Aug 09 02:47:03.200783 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Is-Admin-Project: True Aug 09 02:47:03.200783 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Domain-Id: default Aug 09 02:47:03.200783 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Domain-Name: Default Aug 09 02:47:03.200783 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Id: 8ce26c854fc24cadb2be5ebd441b8f3a Aug 09 02:47:03.200783 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Name: tempest-AttachVolumeNegativeTest-1568455203 Aug 09 02:47:03.200783 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Role: reader,member Aug 09 02:47:03.200783 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Roles: reader,member Aug 09 02:47:03.202510 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8ce26c854fc24cadb2be5ebd441b8f3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8ce26c854fc24cadb2be5ebd441b8f3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8ce26c854fc24cadb2be5ebd441b8f3a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8ce26c854fc24cadb2be5ebd441b8f3a"}]}] Aug 09 02:47:03.202510 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant: tempest-AttachVolumeNegativeTest-1568455203 Aug 09 02:47:03.202510 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant-Id: 8ce26c854fc24cadb2be5ebd441b8f3a Aug 09 02:47:03.202510 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1568455203 Aug 09 02:47:03.202510 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User: tempest-AttachVolumeNegativeTest-1568455203-project Aug 09 02:47:03.202510 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Domain-Id: default Aug 09 02:47:03.202510 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Domain-Name: Default Aug 09 02:47:03.202510 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Id: 43232b9b191047f9a3e6ebab7ad36f02 Aug 09 02:47:03.202510 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Name: tempest-AttachVolumeNegativeTest-1568455203-project Aug 09 02:47:03.202510 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: method: > Aug 09 02:47:03.202510 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: exception: Instance 1cc38775-2c7d-4558-8ca9-3a2ef4917949 could not be found. Aug 09 02:47:03.202510 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: action_args: {'id': '1cc38775-2c7d-4558-8ca9-3a2ef4917949'} Aug 09 02:47:03.203542 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 02:47:03.203542 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:03.203542 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 02:47:03.203542 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 02:47:03.203542 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 02:47:03.203542 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 02:47:03.203542 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 02:47:03.203542 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 02:47:03.203542 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 02:47:03.203542 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 02:47:03.203542 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cc38775-2c7d-4558-8ca9-3a2ef4917949 could not be found. Aug 09 02:47:03.203542 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:03.203542 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:47:03.203542 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:03.203542 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:03.203542 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:47:03.203542 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:47:03.203542 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 02:47:03.203542 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 02:47:03.203542 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 02:47:03.204890 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 02:47:03.204890 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 02:47:03.204890 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 02:47:03.204890 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 02:47:03.204890 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 02:47:03.204890 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 02:47:03.204890 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 02:47:03.204890 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 02:47:03.204890 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 02:47:03.204890 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cc38775-2c7d-4558-8ca9-3a2ef4917949 could not be found. Aug 09 02:47:03.204890 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:03.204890 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:47:03.204890 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:03.204890 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:03.204890 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:47:03.204890 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:47:03.204890 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 02:47:03.204890 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 02:47:03.204890 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cc38775-2c7d-4558-8ca9-3a2ef4917949 could not be found. Aug 09 02:47:03.204890 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:03.206123 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-d2411084-4510-412d-addf-833207af2ba0 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Returning 404 to user: Instance 1cc38775-2c7d-4558-8ca9-3a2ef4917949 could not be found. {{(pid=124427) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 02:47:03.206123 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-d2411084-4510-412d-addf-833207af2ba0 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1cc38775-2c7d-4558-8ca9-3a2ef4917949" status: 404 len: 111 microversion: 2.1 time: 0.032772 Aug 09 02:47:03.206123 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 441/859] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 9 02:47:03 2022] DELETE /compute/v2.1/servers/1cc38775-2c7d-4558-8ca9-3a2ef4917949 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 02:47:03.211020 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-a4dd63ef-17a7-4fa7-9bdd-e293fe772d1e tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:03.211623 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-a4dd63ef-17a7-4fa7-9bdd-e293fe772d1e tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 1cc38775-2c7d-4558-8ca9-3a2ef4917949] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:47:03.217701 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a4dd63ef-17a7-4fa7-9bdd-e293fe772d1e tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:03.218237 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a4dd63ef-17a7-4fa7-9bdd-e293fe772d1e tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:03.218663 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a4dd63ef-17a7-4fa7-9bdd-e293fe772d1e tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:03.219343 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a4dd63ef-17a7-4fa7-9bdd-e293fe772d1e tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:03.219788 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a4dd63ef-17a7-4fa7-9bdd-e293fe772d1e tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:03.220318 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a4dd63ef-17a7-4fa7-9bdd-e293fe772d1e tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:03.235119 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.wsgi [None req-a4dd63ef-17a7-4fa7-9bdd-e293fe772d1e tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] HTTP exception thrown: Instance 1cc38775-2c7d-4558-8ca9-3a2ef4917949 could not be found. Aug 09 02:47:03.236622 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-a4dd63ef-17a7-4fa7-9bdd-e293fe772d1e tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Request method failure captured: Aug 09 02:47:03.236622 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: request: GET /compute/v2.1/servers/1cc38775-2c7d-4558-8ca9-3a2ef4917949 HTTP/1.1 Aug 09 02:47:03.236622 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Accept: application/json Aug 09 02:47:03.236622 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Accept-Encoding: identity Aug 09 02:47:03.236622 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Connection: close Aug 09 02:47:03.236622 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Content-Length: 0 Aug 09 02:47:03.236622 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Content-Type: application/json Aug 09 02:47:03.236622 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Host: 10.222.0.20 Aug 09 02:47:03.236622 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Openstack-System-Scope: None Aug 09 02:47:03.236622 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: User-Agent: python-urllib3/1.26.11 Aug 09 02:47:03.236622 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Auth-Token: gAAAAABi8ckjyQvMSPVjOXRhh70Rnc1ANMFv7G7JLArfSACfDLzvvcneDlsL-sI9hF681zwEIODxGFE7k1OsPJO-SGVxluvBNMmaFLG_fx-H9D1ZvGPLVeuDO_toy5qwJovkKz9pwj7m5cniNs8yMlVJKkLfQNx_gl4pQZFRtesItHh6k1DiYvw Aug 09 02:47:03.236622 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Domain-Id: None Aug 09 02:47:03.236622 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Domain-Name: None Aug 09 02:47:03.236622 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Identity-Status: Confirmed Aug 09 02:47:03.236622 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Is-Admin-Project: True Aug 09 02:47:03.236622 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Domain-Id: default Aug 09 02:47:03.236622 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Domain-Name: Default Aug 09 02:47:03.236622 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Id: 8ce26c854fc24cadb2be5ebd441b8f3a Aug 09 02:47:03.236622 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Name: tempest-AttachVolumeNegativeTest-1568455203 Aug 09 02:47:03.236622 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Role: reader,member Aug 09 02:47:03.236622 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Roles: reader,member Aug 09 02:47:03.238482 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8ce26c854fc24cadb2be5ebd441b8f3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8ce26c854fc24cadb2be5ebd441b8f3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8ce26c854fc24cadb2be5ebd441b8f3a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8ce26c854fc24cadb2be5ebd441b8f3a"}]}] Aug 09 02:47:03.238482 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant: tempest-AttachVolumeNegativeTest-1568455203 Aug 09 02:47:03.238482 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant-Id: 8ce26c854fc24cadb2be5ebd441b8f3a Aug 09 02:47:03.238482 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1568455203 Aug 09 02:47:03.238482 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User: tempest-AttachVolumeNegativeTest-1568455203-project Aug 09 02:47:03.238482 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Domain-Id: default Aug 09 02:47:03.238482 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Domain-Name: Default Aug 09 02:47:03.238482 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Id: 43232b9b191047f9a3e6ebab7ad36f02 Aug 09 02:47:03.238482 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Name: tempest-AttachVolumeNegativeTest-1568455203-project Aug 09 02:47:03.238482 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: method: > Aug 09 02:47:03.238482 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: exception: Instance 1cc38775-2c7d-4558-8ca9-3a2ef4917949 could not be found. Aug 09 02:47:03.238482 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: action_args: {'id': '1cc38775-2c7d-4558-8ca9-3a2ef4917949'} Aug 09 02:47:03.239234 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 02:47:03.239234 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:03.239234 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 02:47:03.239234 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 02:47:03.239234 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 02:47:03.239234 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 02:47:03.239234 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 02:47:03.239234 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 02:47:03.239234 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 02:47:03.239234 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 02:47:03.239234 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cc38775-2c7d-4558-8ca9-3a2ef4917949 could not be found. Aug 09 02:47:03.239234 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:03.239234 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:47:03.239234 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:03.239234 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:03.239234 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:47:03.239234 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:47:03.239234 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 02:47:03.239234 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 02:47:03.239234 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 02:47:03.240473 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 02:47:03.240473 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 02:47:03.240473 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 02:47:03.240473 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 02:47:03.240473 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 02:47:03.240473 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 02:47:03.240473 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 02:47:03.240473 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cc38775-2c7d-4558-8ca9-3a2ef4917949 could not be found. Aug 09 02:47:03.240473 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:03.240473 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:47:03.240473 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:03.240473 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:03.240473 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:47:03.240473 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:47:03.240473 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 02:47:03.240473 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 02:47:03.240473 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cc38775-2c7d-4558-8ca9-3a2ef4917949 could not be found. Aug 09 02:47:03.240473 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:03.241623 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-a4dd63ef-17a7-4fa7-9bdd-e293fe772d1e tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Returning 404 to user: Instance 1cc38775-2c7d-4558-8ca9-3a2ef4917949 could not be found. {{(pid=124427) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 02:47:03.241623 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-a4dd63ef-17a7-4fa7-9bdd-e293fe772d1e tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/1cc38775-2c7d-4558-8ca9-3a2ef4917949" status: 404 len: 111 microversion: 2.1 time: 0.031106 Aug 09 02:47:03.241623 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 442/860] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:47:03 2022] GET /compute/v2.1/servers/1cc38775-2c7d-4558-8ca9-3a2ef4917949 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 02:47:03.272114 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-6ed79783-166f-4c34-a3ca-5e5270dbae27 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "POST /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549/action" status: 202 len: 0 microversion: 2.20 time: 0.256751 Aug 09 02:47:03.272673 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 419/861] 10.222.0.20 () {62 vars in 1319 bytes} [Tue Aug 9 02:47:03 2022] POST /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 02:47:03.281924 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-e76aa24e-12e6-46bf-9b0e-fea394ec7036 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:03.282913 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-e76aa24e-12e6-46bf-9b0e-fea394ec7036 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:47:03.289655 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e76aa24e-12e6-46bf-9b0e-fea394ec7036 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:03.290701 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e76aa24e-12e6-46bf-9b0e-fea394ec7036 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:03.291105 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e76aa24e-12e6-46bf-9b0e-fea394ec7036 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:03.292057 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e76aa24e-12e6-46bf-9b0e-fea394ec7036 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:03.292519 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e76aa24e-12e6-46bf-9b0e-fea394ec7036 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:03.292941 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e76aa24e-12e6-46bf-9b0e-fea394ec7036 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:03.613610 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-e76aa24e-12e6-46bf-9b0e-fea394ec7036 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:03.622352 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-e76aa24e-12e6-46bf-9b0e-fea394ec7036 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:03.623865 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-e76aa24e-12e6-46bf-9b0e-fea394ec7036 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:03.625154 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-e76aa24e-12e6-46bf-9b0e-fea394ec7036 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 200 len: 1720 microversion: 2.20 time: 0.347713 Aug 09 02:47:03.625721 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 443/862] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:47:03 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 1720 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:47:04.431242 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-0b6e56b7-682d-45bf-a6b6-e85a7478d23c tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:04.431794 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-0b6e56b7-682d-45bf-a6b6-e85a7478d23c tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 3cda6c0b-68ff-41dd-aa38-48cbafba8451] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:47:04.438670 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0b6e56b7-682d-45bf-a6b6-e85a7478d23c tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:04.439146 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0b6e56b7-682d-45bf-a6b6-e85a7478d23c tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:04.439572 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0b6e56b7-682d-45bf-a6b6-e85a7478d23c tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:04.440255 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0b6e56b7-682d-45bf-a6b6-e85a7478d23c tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:04.440699 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0b6e56b7-682d-45bf-a6b6-e85a7478d23c tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:04.441109 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0b6e56b7-682d-45bf-a6b6-e85a7478d23c tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:04.462198 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.wsgi [None req-0b6e56b7-682d-45bf-a6b6-e85a7478d23c tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] HTTP exception thrown: Instance 3cda6c0b-68ff-41dd-aa38-48cbafba8451 could not be found. Aug 09 02:47:04.463910 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-0b6e56b7-682d-45bf-a6b6-e85a7478d23c tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Request method failure captured: Aug 09 02:47:04.463910 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: request: DELETE /compute/v2.1/servers/3cda6c0b-68ff-41dd-aa38-48cbafba8451 HTTP/1.1 Aug 09 02:47:04.463910 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Accept: application/json Aug 09 02:47:04.463910 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Accept-Encoding: identity Aug 09 02:47:04.463910 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Connection: close Aug 09 02:47:04.463910 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Content-Length: 0 Aug 09 02:47:04.463910 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Content-Type: application/json Aug 09 02:47:04.463910 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Host: 10.222.0.20 Aug 09 02:47:04.463910 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Openstack-System-Scope: None Aug 09 02:47:04.463910 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: User-Agent: python-urllib3/1.26.11 Aug 09 02:47:04.463910 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Auth-Token: gAAAAABi8ckjyQvMSPVjOXRhh70Rnc1ANMFv7G7JLArfSACfDLzvvcneDlsL-sI9hF681zwEIODxGFE7k1OsPJO-SGVxluvBNMmaFLG_fx-H9D1ZvGPLVeuDO_toy5qwJovkKz9pwj7m5cniNs8yMlVJKkLfQNx_gl4pQZFRtesItHh6k1DiYvw Aug 09 02:47:04.463910 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Domain-Id: None Aug 09 02:47:04.463910 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Domain-Name: None Aug 09 02:47:04.463910 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Identity-Status: Confirmed Aug 09 02:47:04.463910 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Is-Admin-Project: True Aug 09 02:47:04.463910 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Domain-Id: default Aug 09 02:47:04.463910 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Domain-Name: Default Aug 09 02:47:04.463910 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Id: 8ce26c854fc24cadb2be5ebd441b8f3a Aug 09 02:47:04.463910 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Name: tempest-AttachVolumeNegativeTest-1568455203 Aug 09 02:47:04.463910 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Role: reader,member Aug 09 02:47:04.463910 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Roles: reader,member Aug 09 02:47:04.465356 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8ce26c854fc24cadb2be5ebd441b8f3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8ce26c854fc24cadb2be5ebd441b8f3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8ce26c854fc24cadb2be5ebd441b8f3a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8ce26c854fc24cadb2be5ebd441b8f3a"}]}] Aug 09 02:47:04.465356 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant: tempest-AttachVolumeNegativeTest-1568455203 Aug 09 02:47:04.465356 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant-Id: 8ce26c854fc24cadb2be5ebd441b8f3a Aug 09 02:47:04.465356 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1568455203 Aug 09 02:47:04.465356 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User: tempest-AttachVolumeNegativeTest-1568455203-project Aug 09 02:47:04.465356 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Domain-Id: default Aug 09 02:47:04.465356 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Domain-Name: Default Aug 09 02:47:04.465356 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Id: 43232b9b191047f9a3e6ebab7ad36f02 Aug 09 02:47:04.465356 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Name: tempest-AttachVolumeNegativeTest-1568455203-project Aug 09 02:47:04.465356 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: method: > Aug 09 02:47:04.465356 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: exception: Instance 3cda6c0b-68ff-41dd-aa38-48cbafba8451 could not be found. Aug 09 02:47:04.465356 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: action_args: {'id': '3cda6c0b-68ff-41dd-aa38-48cbafba8451'} Aug 09 02:47:04.466195 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 02:47:04.466195 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:04.466195 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 02:47:04.466195 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 02:47:04.466195 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 02:47:04.466195 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 02:47:04.466195 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 02:47:04.466195 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 02:47:04.466195 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 02:47:04.466195 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 02:47:04.466195 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cda6c0b-68ff-41dd-aa38-48cbafba8451 could not be found. Aug 09 02:47:04.466195 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:47:04.466195 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:47:04.466195 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:47:04.466195 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:04.466195 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:47:04.466195 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:47:04.466195 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 02:47:04.466195 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 02:47:04.466195 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 02:47:04.467492 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 02:47:04.467492 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 02:47:04.467492 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 02:47:04.467492 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 02:47:04.467492 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 02:47:04.467492 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 02:47:04.467492 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 02:47:04.467492 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 02:47:04.467492 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 02:47:04.467492 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cda6c0b-68ff-41dd-aa38-48cbafba8451 could not be found. Aug 09 02:47:04.467492 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:47:04.467492 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:47:04.467492 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:47:04.467492 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:04.467492 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:47:04.467492 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:47:04.467492 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 02:47:04.467492 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 02:47:04.467492 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cda6c0b-68ff-41dd-aa38-48cbafba8451 could not be found. Aug 09 02:47:04.467492 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:47:04.468892 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-0b6e56b7-682d-45bf-a6b6-e85a7478d23c tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Returning 404 to user: Instance 3cda6c0b-68ff-41dd-aa38-48cbafba8451 could not be found. {{(pid=124425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 02:47:04.468892 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-0b6e56b7-682d-45bf-a6b6-e85a7478d23c tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3cda6c0b-68ff-41dd-aa38-48cbafba8451" status: 404 len: 111 microversion: 2.1 time: 0.039392 Aug 09 02:47:04.468892 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 420/863] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 9 02:47:04 2022] DELETE /compute/v2.1/servers/3cda6c0b-68ff-41dd-aa38-48cbafba8451 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 02:47:04.474380 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-4e460e31-26a5-43db-aebf-8bdc1e7a356a tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:04.475029 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-4e460e31-26a5-43db-aebf-8bdc1e7a356a tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 3cda6c0b-68ff-41dd-aa38-48cbafba8451] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:47:04.484505 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4e460e31-26a5-43db-aebf-8bdc1e7a356a tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:04.488429 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4e460e31-26a5-43db-aebf-8bdc1e7a356a tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:04.489103 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4e460e31-26a5-43db-aebf-8bdc1e7a356a tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:04.490059 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4e460e31-26a5-43db-aebf-8bdc1e7a356a tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:04.490680 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4e460e31-26a5-43db-aebf-8bdc1e7a356a tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:04.491394 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4e460e31-26a5-43db-aebf-8bdc1e7a356a tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:04.507683 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.wsgi [None req-4e460e31-26a5-43db-aebf-8bdc1e7a356a tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] HTTP exception thrown: Instance 3cda6c0b-68ff-41dd-aa38-48cbafba8451 could not be found. Aug 09 02:47:04.509541 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-4e460e31-26a5-43db-aebf-8bdc1e7a356a tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Request method failure captured: Aug 09 02:47:04.509541 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: request: GET /compute/v2.1/servers/3cda6c0b-68ff-41dd-aa38-48cbafba8451 HTTP/1.1 Aug 09 02:47:04.509541 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Accept: application/json Aug 09 02:47:04.509541 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Accept-Encoding: identity Aug 09 02:47:04.509541 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Connection: close Aug 09 02:47:04.509541 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Content-Length: 0 Aug 09 02:47:04.509541 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Content-Type: application/json Aug 09 02:47:04.509541 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Host: 10.222.0.20 Aug 09 02:47:04.509541 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Openstack-System-Scope: None Aug 09 02:47:04.509541 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: User-Agent: python-urllib3/1.26.11 Aug 09 02:47:04.509541 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Auth-Token: gAAAAABi8ckjyQvMSPVjOXRhh70Rnc1ANMFv7G7JLArfSACfDLzvvcneDlsL-sI9hF681zwEIODxGFE7k1OsPJO-SGVxluvBNMmaFLG_fx-H9D1ZvGPLVeuDO_toy5qwJovkKz9pwj7m5cniNs8yMlVJKkLfQNx_gl4pQZFRtesItHh6k1DiYvw Aug 09 02:47:04.509541 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Domain-Id: None Aug 09 02:47:04.509541 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Domain-Name: None Aug 09 02:47:04.509541 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Identity-Status: Confirmed Aug 09 02:47:04.509541 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Is-Admin-Project: True Aug 09 02:47:04.509541 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Domain-Id: default Aug 09 02:47:04.509541 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Domain-Name: Default Aug 09 02:47:04.509541 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Id: 8ce26c854fc24cadb2be5ebd441b8f3a Aug 09 02:47:04.509541 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Name: tempest-AttachVolumeNegativeTest-1568455203 Aug 09 02:47:04.509541 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Role: reader,member Aug 09 02:47:04.509541 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Roles: reader,member Aug 09 02:47:04.511166 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8ce26c854fc24cadb2be5ebd441b8f3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8ce26c854fc24cadb2be5ebd441b8f3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8ce26c854fc24cadb2be5ebd441b8f3a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8ce26c854fc24cadb2be5ebd441b8f3a"}]}] Aug 09 02:47:04.511166 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant: tempest-AttachVolumeNegativeTest-1568455203 Aug 09 02:47:04.511166 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant-Id: 8ce26c854fc24cadb2be5ebd441b8f3a Aug 09 02:47:04.511166 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1568455203 Aug 09 02:47:04.511166 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User: tempest-AttachVolumeNegativeTest-1568455203-project Aug 09 02:47:04.511166 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Domain-Id: default Aug 09 02:47:04.511166 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Domain-Name: Default Aug 09 02:47:04.511166 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Id: 43232b9b191047f9a3e6ebab7ad36f02 Aug 09 02:47:04.511166 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Name: tempest-AttachVolumeNegativeTest-1568455203-project Aug 09 02:47:04.511166 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: method: > Aug 09 02:47:04.511166 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: exception: Instance 3cda6c0b-68ff-41dd-aa38-48cbafba8451 could not be found. Aug 09 02:47:04.511166 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: action_args: {'id': '3cda6c0b-68ff-41dd-aa38-48cbafba8451'} Aug 09 02:47:04.512069 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 02:47:04.512069 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:04.512069 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 02:47:04.512069 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 02:47:04.512069 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 02:47:04.512069 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 02:47:04.512069 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 02:47:04.512069 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 02:47:04.512069 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 02:47:04.512069 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 02:47:04.512069 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cda6c0b-68ff-41dd-aa38-48cbafba8451 could not be found. Aug 09 02:47:04.512069 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:04.512069 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:47:04.512069 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:04.512069 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:04.512069 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:47:04.512069 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:47:04.512069 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 02:47:04.512069 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 02:47:04.512069 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 02:47:04.513534 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 02:47:04.513534 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 02:47:04.513534 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 02:47:04.513534 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 02:47:04.513534 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 02:47:04.513534 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 02:47:04.513534 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 02:47:04.513534 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cda6c0b-68ff-41dd-aa38-48cbafba8451 could not be found. Aug 09 02:47:04.513534 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:04.513534 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:47:04.513534 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:04.513534 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:04.513534 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:47:04.513534 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:47:04.513534 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 02:47:04.513534 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 02:47:04.513534 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cda6c0b-68ff-41dd-aa38-48cbafba8451 could not be found. Aug 09 02:47:04.513534 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:04.515040 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-4e460e31-26a5-43db-aebf-8bdc1e7a356a tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Returning 404 to user: Instance 3cda6c0b-68ff-41dd-aa38-48cbafba8451 could not be found. {{(pid=124427) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 02:47:04.515040 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-4e460e31-26a5-43db-aebf-8bdc1e7a356a tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/3cda6c0b-68ff-41dd-aa38-48cbafba8451" status: 404 len: 111 microversion: 2.1 time: 0.041309 Aug 09 02:47:04.515040 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 444/864] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:47:04 2022] GET /compute/v2.1/servers/3cda6c0b-68ff-41dd-aa38-48cbafba8451 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 02:47:04.523824 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-1a078b0e-8588-4925-a50b-5be0e6a3f008 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:04.524325 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-1a078b0e-8588-4925-a50b-5be0e6a3f008 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 86989fa1-a3d2-4af9-9e2c-319ac2a8a23c] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:47:04.530491 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1a078b0e-8588-4925-a50b-5be0e6a3f008 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:04.530963 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1a078b0e-8588-4925-a50b-5be0e6a3f008 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:04.531393 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1a078b0e-8588-4925-a50b-5be0e6a3f008 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:04.532072 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1a078b0e-8588-4925-a50b-5be0e6a3f008 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:04.532523 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1a078b0e-8588-4925-a50b-5be0e6a3f008 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:04.532945 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1a078b0e-8588-4925-a50b-5be0e6a3f008 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:04.551492 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.wsgi [None req-1a078b0e-8588-4925-a50b-5be0e6a3f008 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] HTTP exception thrown: Instance 86989fa1-a3d2-4af9-9e2c-319ac2a8a23c could not be found. Aug 09 02:47:04.553141 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-1a078b0e-8588-4925-a50b-5be0e6a3f008 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Request method failure captured: Aug 09 02:47:04.553141 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: request: DELETE /compute/v2.1/servers/86989fa1-a3d2-4af9-9e2c-319ac2a8a23c HTTP/1.1 Aug 09 02:47:04.553141 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Accept: application/json Aug 09 02:47:04.553141 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Accept-Encoding: identity Aug 09 02:47:04.553141 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Connection: close Aug 09 02:47:04.553141 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Content-Length: 0 Aug 09 02:47:04.553141 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Content-Type: application/json Aug 09 02:47:04.553141 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Host: 10.222.0.20 Aug 09 02:47:04.553141 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Openstack-System-Scope: None Aug 09 02:47:04.553141 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: User-Agent: python-urllib3/1.26.11 Aug 09 02:47:04.553141 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Auth-Token: gAAAAABi8ckjyQvMSPVjOXRhh70Rnc1ANMFv7G7JLArfSACfDLzvvcneDlsL-sI9hF681zwEIODxGFE7k1OsPJO-SGVxluvBNMmaFLG_fx-H9D1ZvGPLVeuDO_toy5qwJovkKz9pwj7m5cniNs8yMlVJKkLfQNx_gl4pQZFRtesItHh6k1DiYvw Aug 09 02:47:04.553141 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Domain-Id: None Aug 09 02:47:04.553141 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Domain-Name: None Aug 09 02:47:04.553141 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Identity-Status: Confirmed Aug 09 02:47:04.553141 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Is-Admin-Project: True Aug 09 02:47:04.553141 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Domain-Id: default Aug 09 02:47:04.553141 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Domain-Name: Default Aug 09 02:47:04.553141 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Id: 8ce26c854fc24cadb2be5ebd441b8f3a Aug 09 02:47:04.553141 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Name: tempest-AttachVolumeNegativeTest-1568455203 Aug 09 02:47:04.553141 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Role: reader,member Aug 09 02:47:04.553141 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Roles: reader,member Aug 09 02:47:04.554894 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8ce26c854fc24cadb2be5ebd441b8f3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8ce26c854fc24cadb2be5ebd441b8f3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8ce26c854fc24cadb2be5ebd441b8f3a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8ce26c854fc24cadb2be5ebd441b8f3a"}]}] Aug 09 02:47:04.554894 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant: tempest-AttachVolumeNegativeTest-1568455203 Aug 09 02:47:04.554894 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant-Id: 8ce26c854fc24cadb2be5ebd441b8f3a Aug 09 02:47:04.554894 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1568455203 Aug 09 02:47:04.554894 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User: tempest-AttachVolumeNegativeTest-1568455203-project Aug 09 02:47:04.554894 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Domain-Id: default Aug 09 02:47:04.554894 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Domain-Name: Default Aug 09 02:47:04.554894 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Id: 43232b9b191047f9a3e6ebab7ad36f02 Aug 09 02:47:04.554894 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Name: tempest-AttachVolumeNegativeTest-1568455203-project Aug 09 02:47:04.554894 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: method: > Aug 09 02:47:04.554894 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: exception: Instance 86989fa1-a3d2-4af9-9e2c-319ac2a8a23c could not be found. Aug 09 02:47:04.554894 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: action_args: {'id': '86989fa1-a3d2-4af9-9e2c-319ac2a8a23c'} Aug 09 02:47:04.555710 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 02:47:04.555710 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:04.555710 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 02:47:04.555710 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 02:47:04.555710 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 02:47:04.555710 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 02:47:04.555710 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 02:47:04.555710 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 02:47:04.555710 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 02:47:04.555710 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 02:47:04.555710 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86989fa1-a3d2-4af9-9e2c-319ac2a8a23c could not be found. Aug 09 02:47:04.555710 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:47:04.555710 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:47:04.555710 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:47:04.555710 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:04.555710 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:47:04.555710 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:47:04.555710 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 02:47:04.555710 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 02:47:04.555710 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 02:47:04.557014 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 02:47:04.557014 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 02:47:04.557014 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 02:47:04.557014 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 02:47:04.557014 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 02:47:04.557014 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 02:47:04.557014 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 02:47:04.557014 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 02:47:04.557014 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 02:47:04.557014 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86989fa1-a3d2-4af9-9e2c-319ac2a8a23c could not be found. Aug 09 02:47:04.557014 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:47:04.557014 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:47:04.557014 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:47:04.557014 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:04.557014 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:47:04.557014 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:47:04.557014 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 02:47:04.557014 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 02:47:04.557014 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86989fa1-a3d2-4af9-9e2c-319ac2a8a23c could not be found. Aug 09 02:47:04.557014 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:47:04.558319 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-1a078b0e-8588-4925-a50b-5be0e6a3f008 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Returning 404 to user: Instance 86989fa1-a3d2-4af9-9e2c-319ac2a8a23c could not be found. {{(pid=124425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 02:47:04.558319 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-1a078b0e-8588-4925-a50b-5be0e6a3f008 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "DELETE /compute/v2.1/servers/86989fa1-a3d2-4af9-9e2c-319ac2a8a23c" status: 404 len: 111 microversion: 2.1 time: 0.034751 Aug 09 02:47:04.558319 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 421/865] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 9 02:47:04 2022] DELETE /compute/v2.1/servers/86989fa1-a3d2-4af9-9e2c-319ac2a8a23c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 02:47:04.565911 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-6d9488a5-6cda-4bb9-88d5-f57ffe68d178 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:04.566795 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-6d9488a5-6cda-4bb9-88d5-f57ffe68d178 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: 86989fa1-a3d2-4af9-9e2c-319ac2a8a23c] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:47:04.576283 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6d9488a5-6cda-4bb9-88d5-f57ffe68d178 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:04.576283 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6d9488a5-6cda-4bb9-88d5-f57ffe68d178 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:04.576283 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6d9488a5-6cda-4bb9-88d5-f57ffe68d178 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:04.576283 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6d9488a5-6cda-4bb9-88d5-f57ffe68d178 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:04.576749 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6d9488a5-6cda-4bb9-88d5-f57ffe68d178 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:04.576920 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6d9488a5-6cda-4bb9-88d5-f57ffe68d178 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:04.591117 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.wsgi [None req-6d9488a5-6cda-4bb9-88d5-f57ffe68d178 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] HTTP exception thrown: Instance 86989fa1-a3d2-4af9-9e2c-319ac2a8a23c could not be found. Aug 09 02:47:04.592630 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-6d9488a5-6cda-4bb9-88d5-f57ffe68d178 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Request method failure captured: Aug 09 02:47:04.592630 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: request: GET /compute/v2.1/servers/86989fa1-a3d2-4af9-9e2c-319ac2a8a23c HTTP/1.1 Aug 09 02:47:04.592630 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Accept: application/json Aug 09 02:47:04.592630 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Accept-Encoding: identity Aug 09 02:47:04.592630 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Connection: close Aug 09 02:47:04.592630 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Content-Length: 0 Aug 09 02:47:04.592630 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Content-Type: application/json Aug 09 02:47:04.592630 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Host: 10.222.0.20 Aug 09 02:47:04.592630 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Openstack-System-Scope: None Aug 09 02:47:04.592630 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: User-Agent: python-urllib3/1.26.11 Aug 09 02:47:04.592630 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Auth-Token: gAAAAABi8ckjyQvMSPVjOXRhh70Rnc1ANMFv7G7JLArfSACfDLzvvcneDlsL-sI9hF681zwEIODxGFE7k1OsPJO-SGVxluvBNMmaFLG_fx-H9D1ZvGPLVeuDO_toy5qwJovkKz9pwj7m5cniNs8yMlVJKkLfQNx_gl4pQZFRtesItHh6k1DiYvw Aug 09 02:47:04.592630 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Domain-Id: None Aug 09 02:47:04.592630 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Domain-Name: None Aug 09 02:47:04.592630 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Identity-Status: Confirmed Aug 09 02:47:04.592630 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Is-Admin-Project: True Aug 09 02:47:04.592630 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Domain-Id: default Aug 09 02:47:04.592630 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Domain-Name: Default Aug 09 02:47:04.592630 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Id: 8ce26c854fc24cadb2be5ebd441b8f3a Aug 09 02:47:04.592630 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Name: tempest-AttachVolumeNegativeTest-1568455203 Aug 09 02:47:04.592630 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Role: reader,member Aug 09 02:47:04.592630 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Roles: reader,member Aug 09 02:47:04.594104 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8ce26c854fc24cadb2be5ebd441b8f3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8ce26c854fc24cadb2be5ebd441b8f3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8ce26c854fc24cadb2be5ebd441b8f3a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8ce26c854fc24cadb2be5ebd441b8f3a"}]}] Aug 09 02:47:04.594104 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant: tempest-AttachVolumeNegativeTest-1568455203 Aug 09 02:47:04.594104 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant-Id: 8ce26c854fc24cadb2be5ebd441b8f3a Aug 09 02:47:04.594104 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1568455203 Aug 09 02:47:04.594104 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User: tempest-AttachVolumeNegativeTest-1568455203-project Aug 09 02:47:04.594104 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Domain-Id: default Aug 09 02:47:04.594104 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Domain-Name: Default Aug 09 02:47:04.594104 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Id: 43232b9b191047f9a3e6ebab7ad36f02 Aug 09 02:47:04.594104 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Name: tempest-AttachVolumeNegativeTest-1568455203-project Aug 09 02:47:04.594104 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: method: > Aug 09 02:47:04.594104 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: exception: Instance 86989fa1-a3d2-4af9-9e2c-319ac2a8a23c could not be found. Aug 09 02:47:04.594104 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: action_args: {'id': '86989fa1-a3d2-4af9-9e2c-319ac2a8a23c'} Aug 09 02:47:04.595096 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 02:47:04.595096 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:04.595096 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 02:47:04.595096 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 02:47:04.595096 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 02:47:04.595096 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 02:47:04.595096 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 02:47:04.595096 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 02:47:04.595096 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 02:47:04.595096 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 02:47:04.595096 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86989fa1-a3d2-4af9-9e2c-319ac2a8a23c could not be found. Aug 09 02:47:04.595096 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:04.595096 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:47:04.595096 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:04.595096 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:04.595096 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:47:04.595096 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:47:04.595096 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 02:47:04.595096 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 02:47:04.595096 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 02:47:04.596582 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 02:47:04.596582 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 02:47:04.596582 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 02:47:04.596582 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 02:47:04.596582 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 02:47:04.596582 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 02:47:04.596582 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 02:47:04.596582 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86989fa1-a3d2-4af9-9e2c-319ac2a8a23c could not be found. Aug 09 02:47:04.596582 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:04.596582 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:47:04.596582 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:04.596582 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:04.596582 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:47:04.596582 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:47:04.596582 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 02:47:04.596582 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 02:47:04.596582 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86989fa1-a3d2-4af9-9e2c-319ac2a8a23c could not be found. Aug 09 02:47:04.596582 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:04.598210 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-6d9488a5-6cda-4bb9-88d5-f57ffe68d178 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Returning 404 to user: Instance 86989fa1-a3d2-4af9-9e2c-319ac2a8a23c could not be found. {{(pid=124427) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 02:47:04.598210 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-6d9488a5-6cda-4bb9-88d5-f57ffe68d178 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/86989fa1-a3d2-4af9-9e2c-319ac2a8a23c" status: 404 len: 111 microversion: 2.1 time: 0.034454 Aug 09 02:47:04.598210 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 445/866] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:47:04 2022] GET /compute/v2.1/servers/86989fa1-a3d2-4af9-9e2c-319ac2a8a23c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 02:47:04.650784 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-e8059472-fe55-445e-8fbb-db09906c3d22 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:04.652049 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-e8059472-fe55-445e-8fbb-db09906c3d22 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:47:04.660104 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e8059472-fe55-445e-8fbb-db09906c3d22 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:04.660826 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e8059472-fe55-445e-8fbb-db09906c3d22 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:04.661336 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e8059472-fe55-445e-8fbb-db09906c3d22 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:04.662037 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e8059472-fe55-445e-8fbb-db09906c3d22 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:04.662516 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e8059472-fe55-445e-8fbb-db09906c3d22 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:04.662936 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e8059472-fe55-445e-8fbb-db09906c3d22 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:04.816529 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-e8059472-fe55-445e-8fbb-db09906c3d22 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:04.829662 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-e8059472-fe55-445e-8fbb-db09906c3d22 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:04.831284 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-e8059472-fe55-445e-8fbb-db09906c3d22 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:04.832469 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-e8059472-fe55-445e-8fbb-db09906c3d22 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 200 len: 1720 microversion: 2.20 time: 0.186726 Aug 09 02:47:04.833014 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 422/867] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:47:04 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 1720 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:47:04.836631 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-508b8453-be99-4224-b184-c18aade24683 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:04.837216 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-508b8453-be99-4224-b184-c18aade24683 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: ac4668e2-6e51-4087-bfca-a22cff3b147f] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:47:04.843551 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-508b8453-be99-4224-b184-c18aade24683 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:04.844142 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-508b8453-be99-4224-b184-c18aade24683 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:04.844644 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-508b8453-be99-4224-b184-c18aade24683 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:04.845396 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-508b8453-be99-4224-b184-c18aade24683 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:04.845916 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-508b8453-be99-4224-b184-c18aade24683 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:04.846420 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-508b8453-be99-4224-b184-c18aade24683 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:04.861230 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.wsgi [None req-508b8453-be99-4224-b184-c18aade24683 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] HTTP exception thrown: Instance ac4668e2-6e51-4087-bfca-a22cff3b147f could not be found. Aug 09 02:47:04.863217 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-508b8453-be99-4224-b184-c18aade24683 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Request method failure captured: Aug 09 02:47:04.863217 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: request: DELETE /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f HTTP/1.1 Aug 09 02:47:04.863217 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Accept: application/json Aug 09 02:47:04.863217 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Accept-Encoding: identity Aug 09 02:47:04.863217 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Connection: close Aug 09 02:47:04.863217 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Content-Length: 0 Aug 09 02:47:04.863217 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Content-Type: application/json Aug 09 02:47:04.863217 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Host: 10.222.0.20 Aug 09 02:47:04.863217 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Openstack-System-Scope: None Aug 09 02:47:04.863217 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: User-Agent: python-urllib3/1.26.11 Aug 09 02:47:04.863217 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Auth-Token: gAAAAABi8ckyQ7BoJhOISZ_aEyRwvtOf6wBg9xUi9Vu7KodpYSACalrsvz2rvL1C_mIOt-qr3Bi3jUgZqn7iqf0560XT8zZG6jy4ZTCN9qg5QZL2v5rqXFvpy1e6ziUjE1jR1eQoZ7H0yZm_ukrqaTXnceGFTdwFzKa-RsIlRVyuWjAiXqqozsE Aug 09 02:47:04.863217 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Domain-Id: None Aug 09 02:47:04.863217 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Domain-Name: None Aug 09 02:47:04.863217 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Identity-Status: Confirmed Aug 09 02:47:04.863217 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Is-Admin-Project: True Aug 09 02:47:04.863217 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Domain-Id: default Aug 09 02:47:04.863217 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Domain-Name: Default Aug 09 02:47:04.863217 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Id: 467b42c2bec74fcbbf90d007a6e00096 Aug 09 02:47:04.863217 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Name: tempest-AttachVolumeTestJSON-1583791890 Aug 09 02:47:04.863217 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Role: reader,member Aug 09 02:47:04.863217 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Roles: reader,member Aug 09 02:47:04.864742 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/467b42c2bec74fcbbf90d007a6e00096"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/467b42c2bec74fcbbf90d007a6e00096"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_467b42c2bec74fcbbf90d007a6e00096"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/467b42c2bec74fcbbf90d007a6e00096"}]}] Aug 09 02:47:04.864742 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant: tempest-AttachVolumeTestJSON-1583791890 Aug 09 02:47:04.864742 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant-Id: 467b42c2bec74fcbbf90d007a6e00096 Aug 09 02:47:04.864742 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1583791890 Aug 09 02:47:04.864742 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User: tempest-AttachVolumeTestJSON-1583791890-project Aug 09 02:47:04.864742 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Domain-Id: default Aug 09 02:47:04.864742 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Domain-Name: Default Aug 09 02:47:04.864742 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Id: 2aaa8a7f386e4ccc9ab5c356cdf1704f Aug 09 02:47:04.864742 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Name: tempest-AttachVolumeTestJSON-1583791890-project Aug 09 02:47:04.864742 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: method: > Aug 09 02:47:04.864742 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: exception: Instance ac4668e2-6e51-4087-bfca-a22cff3b147f could not be found. Aug 09 02:47:04.864742 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: action_args: {'id': 'ac4668e2-6e51-4087-bfca-a22cff3b147f'} Aug 09 02:47:04.865721 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 02:47:04.865721 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:04.865721 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 02:47:04.865721 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 02:47:04.865721 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 02:47:04.865721 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 02:47:04.865721 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 02:47:04.865721 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 02:47:04.865721 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 02:47:04.865721 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 02:47:04.865721 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac4668e2-6e51-4087-bfca-a22cff3b147f could not be found. Aug 09 02:47:04.865721 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:04.865721 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:47:04.865721 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:04.865721 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:04.865721 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:47:04.865721 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:47:04.865721 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 02:47:04.865721 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 02:47:04.865721 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 02:47:04.867182 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 02:47:04.867182 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 02:47:04.867182 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 02:47:04.867182 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 02:47:04.867182 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 02:47:04.867182 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 02:47:04.867182 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 02:47:04.867182 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 02:47:04.867182 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 02:47:04.867182 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac4668e2-6e51-4087-bfca-a22cff3b147f could not be found. Aug 09 02:47:04.867182 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:04.867182 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:47:04.867182 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:04.867182 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:04.867182 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:47:04.867182 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:47:04.867182 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 02:47:04.867182 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 02:47:04.867182 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac4668e2-6e51-4087-bfca-a22cff3b147f could not be found. Aug 09 02:47:04.867182 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:04.868777 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-508b8453-be99-4224-b184-c18aade24683 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Returning 404 to user: Instance ac4668e2-6e51-4087-bfca-a22cff3b147f could not be found. {{(pid=124427) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 02:47:04.868777 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-508b8453-be99-4224-b184-c18aade24683 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f" status: 404 len: 111 microversion: 2.1 time: 0.032213 Aug 09 02:47:04.868777 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 446/868] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 9 02:47:04 2022] DELETE /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 02:47:04.873486 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-32c6baa6-9916-4dfe-a048-fb8f21c58337 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:04.874231 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-32c6baa6-9916-4dfe-a048-fb8f21c58337 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: ac4668e2-6e51-4087-bfca-a22cff3b147f] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:47:04.880135 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-32c6baa6-9916-4dfe-a048-fb8f21c58337 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:04.880666 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-32c6baa6-9916-4dfe-a048-fb8f21c58337 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:04.881097 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-32c6baa6-9916-4dfe-a048-fb8f21c58337 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:04.881780 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-32c6baa6-9916-4dfe-a048-fb8f21c58337 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:04.882314 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-32c6baa6-9916-4dfe-a048-fb8f21c58337 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:04.882801 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-32c6baa6-9916-4dfe-a048-fb8f21c58337 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:04.896137 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.wsgi [None req-32c6baa6-9916-4dfe-a048-fb8f21c58337 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] HTTP exception thrown: Instance ac4668e2-6e51-4087-bfca-a22cff3b147f could not be found. Aug 09 02:47:04.897694 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-32c6baa6-9916-4dfe-a048-fb8f21c58337 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Request method failure captured: Aug 09 02:47:04.897694 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: request: GET /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f HTTP/1.1 Aug 09 02:47:04.897694 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Accept: application/json Aug 09 02:47:04.897694 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Accept-Encoding: identity Aug 09 02:47:04.897694 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Connection: close Aug 09 02:47:04.897694 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Content-Length: 0 Aug 09 02:47:04.897694 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Content-Type: application/json Aug 09 02:47:04.897694 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Host: 10.222.0.20 Aug 09 02:47:04.897694 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Openstack-System-Scope: None Aug 09 02:47:04.897694 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: User-Agent: python-urllib3/1.26.11 Aug 09 02:47:04.897694 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Auth-Token: gAAAAABi8ckyQ7BoJhOISZ_aEyRwvtOf6wBg9xUi9Vu7KodpYSACalrsvz2rvL1C_mIOt-qr3Bi3jUgZqn7iqf0560XT8zZG6jy4ZTCN9qg5QZL2v5rqXFvpy1e6ziUjE1jR1eQoZ7H0yZm_ukrqaTXnceGFTdwFzKa-RsIlRVyuWjAiXqqozsE Aug 09 02:47:04.897694 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Domain-Id: None Aug 09 02:47:04.897694 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Domain-Name: None Aug 09 02:47:04.897694 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Identity-Status: Confirmed Aug 09 02:47:04.897694 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Is-Admin-Project: True Aug 09 02:47:04.897694 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Domain-Id: default Aug 09 02:47:04.897694 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Domain-Name: Default Aug 09 02:47:04.897694 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Id: 467b42c2bec74fcbbf90d007a6e00096 Aug 09 02:47:04.897694 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Name: tempest-AttachVolumeTestJSON-1583791890 Aug 09 02:47:04.897694 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Role: reader,member Aug 09 02:47:04.897694 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Roles: reader,member Aug 09 02:47:04.899277 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/467b42c2bec74fcbbf90d007a6e00096"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/467b42c2bec74fcbbf90d007a6e00096"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_467b42c2bec74fcbbf90d007a6e00096"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/467b42c2bec74fcbbf90d007a6e00096"}]}] Aug 09 02:47:04.899277 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant: tempest-AttachVolumeTestJSON-1583791890 Aug 09 02:47:04.899277 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant-Id: 467b42c2bec74fcbbf90d007a6e00096 Aug 09 02:47:04.899277 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1583791890 Aug 09 02:47:04.899277 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User: tempest-AttachVolumeTestJSON-1583791890-project Aug 09 02:47:04.899277 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Domain-Id: default Aug 09 02:47:04.899277 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Domain-Name: Default Aug 09 02:47:04.899277 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Id: 2aaa8a7f386e4ccc9ab5c356cdf1704f Aug 09 02:47:04.899277 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Name: tempest-AttachVolumeTestJSON-1583791890-project Aug 09 02:47:04.899277 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: method: > Aug 09 02:47:04.899277 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: exception: Instance ac4668e2-6e51-4087-bfca-a22cff3b147f could not be found. Aug 09 02:47:04.899277 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: action_args: {'id': 'ac4668e2-6e51-4087-bfca-a22cff3b147f'} Aug 09 02:47:04.900013 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 02:47:04.900013 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:04.900013 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 02:47:04.900013 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 02:47:04.900013 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 02:47:04.900013 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 02:47:04.900013 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 02:47:04.900013 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 02:47:04.900013 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 02:47:04.900013 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 02:47:04.900013 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac4668e2-6e51-4087-bfca-a22cff3b147f could not be found. Aug 09 02:47:04.900013 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:47:04.900013 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:47:04.900013 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:47:04.900013 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:04.900013 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:47:04.900013 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:47:04.900013 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 02:47:04.900013 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 02:47:04.900013 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 02:47:04.901225 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 02:47:04.901225 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 02:47:04.901225 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 02:47:04.901225 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 02:47:04.901225 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 02:47:04.901225 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 02:47:04.901225 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 02:47:04.901225 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac4668e2-6e51-4087-bfca-a22cff3b147f could not be found. Aug 09 02:47:04.901225 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:47:04.901225 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:47:04.901225 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:47:04.901225 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:04.901225 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:47:04.901225 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:47:04.901225 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 02:47:04.901225 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 02:47:04.901225 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac4668e2-6e51-4087-bfca-a22cff3b147f could not be found. Aug 09 02:47:04.901225 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:47:04.902351 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-32c6baa6-9916-4dfe-a048-fb8f21c58337 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Returning 404 to user: Instance ac4668e2-6e51-4087-bfca-a22cff3b147f could not be found. {{(pid=124425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 02:47:04.902351 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-32c6baa6-9916-4dfe-a048-fb8f21c58337 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f" status: 404 len: 111 microversion: 2.1 time: 0.029514 Aug 09 02:47:04.902351 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 423/869] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:47:04 2022] GET /compute/v2.1/servers/ac4668e2-6e51-4087-bfca-a22cff3b147f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 02:47:05.757903 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-d2d522e1-b5b2-4975-8d51-f2987f7fd587 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:05.758435 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-d2d522e1-b5b2-4975-8d51-f2987f7fd587 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:47:05.765316 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d2d522e1-b5b2-4975-8d51-f2987f7fd587 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:05.765856 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d2d522e1-b5b2-4975-8d51-f2987f7fd587 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:05.766324 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d2d522e1-b5b2-4975-8d51-f2987f7fd587 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:05.767013 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d2d522e1-b5b2-4975-8d51-f2987f7fd587 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:05.767471 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d2d522e1-b5b2-4975-8d51-f2987f7fd587 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:05.767889 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d2d522e1-b5b2-4975-8d51-f2987f7fd587 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:05.781633 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.wsgi [None req-d2d522e1-b5b2-4975-8d51-f2987f7fd587 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] HTTP exception thrown: Instance e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a could not be found. Aug 09 02:47:05.783209 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-d2d522e1-b5b2-4975-8d51-f2987f7fd587 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Request method failure captured: Aug 09 02:47:05.783209 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: request: DELETE /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a HTTP/1.1 Aug 09 02:47:05.783209 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Accept: application/json Aug 09 02:47:05.783209 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Accept-Encoding: identity Aug 09 02:47:05.783209 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Connection: close Aug 09 02:47:05.783209 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Content-Length: 0 Aug 09 02:47:05.783209 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Content-Type: application/json Aug 09 02:47:05.783209 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Host: 10.222.0.20 Aug 09 02:47:05.783209 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Openstack-System-Scope: None Aug 09 02:47:05.783209 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: User-Agent: python-urllib3/1.26.11 Aug 09 02:47:05.783209 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Auth-Token: gAAAAABi8ckjyQvMSPVjOXRhh70Rnc1ANMFv7G7JLArfSACfDLzvvcneDlsL-sI9hF681zwEIODxGFE7k1OsPJO-SGVxluvBNMmaFLG_fx-H9D1ZvGPLVeuDO_toy5qwJovkKz9pwj7m5cniNs8yMlVJKkLfQNx_gl4pQZFRtesItHh6k1DiYvw Aug 09 02:47:05.783209 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Domain-Id: None Aug 09 02:47:05.783209 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Domain-Name: None Aug 09 02:47:05.783209 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Identity-Status: Confirmed Aug 09 02:47:05.783209 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Is-Admin-Project: True Aug 09 02:47:05.783209 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Domain-Id: default Aug 09 02:47:05.783209 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Domain-Name: Default Aug 09 02:47:05.783209 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Id: 8ce26c854fc24cadb2be5ebd441b8f3a Aug 09 02:47:05.783209 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Name: tempest-AttachVolumeNegativeTest-1568455203 Aug 09 02:47:05.783209 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Role: reader,member Aug 09 02:47:05.783209 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Roles: reader,member Aug 09 02:47:05.784734 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8ce26c854fc24cadb2be5ebd441b8f3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8ce26c854fc24cadb2be5ebd441b8f3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8ce26c854fc24cadb2be5ebd441b8f3a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8ce26c854fc24cadb2be5ebd441b8f3a"}]}] Aug 09 02:47:05.784734 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant: tempest-AttachVolumeNegativeTest-1568455203 Aug 09 02:47:05.784734 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant-Id: 8ce26c854fc24cadb2be5ebd441b8f3a Aug 09 02:47:05.784734 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1568455203 Aug 09 02:47:05.784734 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User: tempest-AttachVolumeNegativeTest-1568455203-project Aug 09 02:47:05.784734 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Domain-Id: default Aug 09 02:47:05.784734 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Domain-Name: Default Aug 09 02:47:05.784734 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Id: 43232b9b191047f9a3e6ebab7ad36f02 Aug 09 02:47:05.784734 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Name: tempest-AttachVolumeNegativeTest-1568455203-project Aug 09 02:47:05.784734 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: method: > Aug 09 02:47:05.784734 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: exception: Instance e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a could not be found. Aug 09 02:47:05.784734 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: action_args: {'id': 'e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a'} Aug 09 02:47:05.788442 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 02:47:05.788442 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:05.788442 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 02:47:05.788442 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 02:47:05.788442 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 02:47:05.788442 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 02:47:05.788442 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 02:47:05.788442 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 02:47:05.788442 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 02:47:05.788442 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 02:47:05.788442 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a could not be found. Aug 09 02:47:05.788442 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:05.788442 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:47:05.788442 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:05.788442 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:05.788442 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:47:05.788442 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:47:05.788442 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 02:47:05.788442 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 02:47:05.788442 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 02:47:05.789831 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 02:47:05.789831 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 02:47:05.789831 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 02:47:05.789831 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 02:47:05.789831 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 02:47:05.789831 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 02:47:05.789831 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 02:47:05.789831 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 02:47:05.789831 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 02:47:05.789831 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a could not be found. Aug 09 02:47:05.789831 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:05.789831 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:47:05.789831 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:05.789831 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:05.789831 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:47:05.789831 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:47:05.789831 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 02:47:05.789831 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 02:47:05.789831 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a could not be found. Aug 09 02:47:05.789831 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:05.791119 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-d2d522e1-b5b2-4975-8d51-f2987f7fd587 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Returning 404 to user: Instance e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a could not be found. {{(pid=124427) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 02:47:05.791119 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-d2d522e1-b5b2-4975-8d51-f2987f7fd587 tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a" status: 404 len: 111 microversion: 2.1 time: 0.030649 Aug 09 02:47:05.791119 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 447/870] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 9 02:47:05 2022] DELETE /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 02:47:05.793847 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-580042e9-8fc2-4d39-bd0a-5718039c9f2b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:05.794544 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-580042e9-8fc2-4d39-bd0a-5718039c9f2b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] [instance: e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:47:05.803985 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-580042e9-8fc2-4d39-bd0a-5718039c9f2b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:05.804622 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-580042e9-8fc2-4d39-bd0a-5718039c9f2b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:05.806057 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-580042e9-8fc2-4d39-bd0a-5718039c9f2b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:05.807535 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-580042e9-8fc2-4d39-bd0a-5718039c9f2b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:05.808164 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-580042e9-8fc2-4d39-bd0a-5718039c9f2b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:05.808592 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-580042e9-8fc2-4d39-bd0a-5718039c9f2b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:05.823467 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.wsgi [None req-580042e9-8fc2-4d39-bd0a-5718039c9f2b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] HTTP exception thrown: Instance e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a could not be found. Aug 09 02:47:05.825165 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-580042e9-8fc2-4d39-bd0a-5718039c9f2b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Request method failure captured: Aug 09 02:47:05.825165 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: request: GET /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a HTTP/1.1 Aug 09 02:47:05.825165 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Accept: application/json Aug 09 02:47:05.825165 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Accept-Encoding: identity Aug 09 02:47:05.825165 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Connection: close Aug 09 02:47:05.825165 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Content-Length: 0 Aug 09 02:47:05.825165 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Content-Type: application/json Aug 09 02:47:05.825165 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Host: 10.222.0.20 Aug 09 02:47:05.825165 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Openstack-System-Scope: None Aug 09 02:47:05.825165 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: User-Agent: python-urllib3/1.26.11 Aug 09 02:47:05.825165 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Auth-Token: gAAAAABi8ckjyQvMSPVjOXRhh70Rnc1ANMFv7G7JLArfSACfDLzvvcneDlsL-sI9hF681zwEIODxGFE7k1OsPJO-SGVxluvBNMmaFLG_fx-H9D1ZvGPLVeuDO_toy5qwJovkKz9pwj7m5cniNs8yMlVJKkLfQNx_gl4pQZFRtesItHh6k1DiYvw Aug 09 02:47:05.825165 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Domain-Id: None Aug 09 02:47:05.825165 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Domain-Name: None Aug 09 02:47:05.825165 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Identity-Status: Confirmed Aug 09 02:47:05.825165 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Is-Admin-Project: True Aug 09 02:47:05.825165 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Domain-Id: default Aug 09 02:47:05.825165 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Domain-Name: Default Aug 09 02:47:05.825165 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Id: 8ce26c854fc24cadb2be5ebd441b8f3a Aug 09 02:47:05.825165 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Name: tempest-AttachVolumeNegativeTest-1568455203 Aug 09 02:47:05.825165 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Role: reader,member Aug 09 02:47:05.825165 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Roles: reader,member Aug 09 02:47:05.826835 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8ce26c854fc24cadb2be5ebd441b8f3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8ce26c854fc24cadb2be5ebd441b8f3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8ce26c854fc24cadb2be5ebd441b8f3a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8ce26c854fc24cadb2be5ebd441b8f3a"}]}] Aug 09 02:47:05.826835 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant: tempest-AttachVolumeNegativeTest-1568455203 Aug 09 02:47:05.826835 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant-Id: 8ce26c854fc24cadb2be5ebd441b8f3a Aug 09 02:47:05.826835 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1568455203 Aug 09 02:47:05.826835 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User: tempest-AttachVolumeNegativeTest-1568455203-project Aug 09 02:47:05.826835 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Domain-Id: default Aug 09 02:47:05.826835 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Domain-Name: Default Aug 09 02:47:05.826835 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Id: 43232b9b191047f9a3e6ebab7ad36f02 Aug 09 02:47:05.826835 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Name: tempest-AttachVolumeNegativeTest-1568455203-project Aug 09 02:47:05.826835 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: method: > Aug 09 02:47:05.826835 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: exception: Instance e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a could not be found. Aug 09 02:47:05.826835 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: action_args: {'id': 'e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a'} Aug 09 02:47:05.828179 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 02:47:05.828179 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:05.828179 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 02:47:05.828179 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 02:47:05.828179 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 02:47:05.828179 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 02:47:05.828179 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 02:47:05.828179 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 02:47:05.828179 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 02:47:05.828179 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 02:47:05.828179 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a could not be found. Aug 09 02:47:05.828179 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:47:05.828179 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:47:05.828179 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:47:05.828179 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:05.828179 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:47:05.828179 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:47:05.828179 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 02:47:05.828179 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 02:47:05.828179 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 02:47:05.830271 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 02:47:05.830271 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 02:47:05.830271 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 02:47:05.830271 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 02:47:05.830271 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 02:47:05.830271 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 02:47:05.830271 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 02:47:05.830271 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a could not be found. Aug 09 02:47:05.830271 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:47:05.830271 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:47:05.830271 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:47:05.830271 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:05.830271 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:47:05.830271 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:47:05.830271 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 02:47:05.830271 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 02:47:05.830271 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a could not be found. Aug 09 02:47:05.830271 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:47:05.832718 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-580042e9-8fc2-4d39-bd0a-5718039c9f2b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] Returning 404 to user: Instance e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a could not be found. {{(pid=124425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 02:47:05.832718 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-580042e9-8fc2-4d39-bd0a-5718039c9f2b tempest-AttachVolumeNegativeTest-1568455203 tempest-AttachVolumeNegativeTest-1568455203-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a" status: 404 len: 111 microversion: 2.1 time: 0.037535 Aug 09 02:47:05.832718 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 424/871] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:47:05 2022] GET /compute/v2.1/servers/e3f5165a-7fe9-4e47-b6e8-9774aa4a7b5a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 02:47:05.855096 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-59ccfff5-61be-49f4-8d29-f6b65a7603fc tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:05.855729 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-59ccfff5-61be-49f4-8d29-f6b65a7603fc tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:47:05.861819 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-59ccfff5-61be-49f4-8d29-f6b65a7603fc tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:05.862703 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-59ccfff5-61be-49f4-8d29-f6b65a7603fc tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:05.863130 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-59ccfff5-61be-49f4-8d29-f6b65a7603fc tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:05.863827 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-59ccfff5-61be-49f4-8d29-f6b65a7603fc tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:05.864232 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-59ccfff5-61be-49f4-8d29-f6b65a7603fc tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:05.864650 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-59ccfff5-61be-49f4-8d29-f6b65a7603fc tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:06.038874 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-2b04646a-fdd7-4ae7-83a2-0e69abd17ead tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:06.039397 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-2b04646a-fdd7-4ae7-83a2-0e69abd17ead tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:47:06.045563 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2b04646a-fdd7-4ae7-83a2-0e69abd17ead tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:06.046181 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2b04646a-fdd7-4ae7-83a2-0e69abd17ead tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:06.046781 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2b04646a-fdd7-4ae7-83a2-0e69abd17ead tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:06.047410 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2b04646a-fdd7-4ae7-83a2-0e69abd17ead tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:06.047898 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2b04646a-fdd7-4ae7-83a2-0e69abd17ead tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:06.048353 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2b04646a-fdd7-4ae7-83a2-0e69abd17ead tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:06.062675 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.wsgi [None req-2b04646a-fdd7-4ae7-83a2-0e69abd17ead tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] HTTP exception thrown: Instance 8f16a110-9dc8-4e95-b6de-c30feee35b89 could not be found. Aug 09 02:47:06.064405 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-2b04646a-fdd7-4ae7-83a2-0e69abd17ead tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Request method failure captured: Aug 09 02:47:06.064405 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: request: DELETE /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 HTTP/1.1 Aug 09 02:47:06.064405 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Accept: application/json Aug 09 02:47:06.064405 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Accept-Encoding: identity Aug 09 02:47:06.064405 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Connection: close Aug 09 02:47:06.064405 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Content-Length: 0 Aug 09 02:47:06.064405 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Content-Type: application/json Aug 09 02:47:06.064405 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Host: 10.222.0.20 Aug 09 02:47:06.064405 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Openstack-System-Scope: None Aug 09 02:47:06.064405 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: User-Agent: python-urllib3/1.26.11 Aug 09 02:47:06.064405 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Auth-Token: gAAAAABi8ckyQ7BoJhOISZ_aEyRwvtOf6wBg9xUi9Vu7KodpYSACalrsvz2rvL1C_mIOt-qr3Bi3jUgZqn7iqf0560XT8zZG6jy4ZTCN9qg5QZL2v5rqXFvpy1e6ziUjE1jR1eQoZ7H0yZm_ukrqaTXnceGFTdwFzKa-RsIlRVyuWjAiXqqozsE Aug 09 02:47:06.064405 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Domain-Id: None Aug 09 02:47:06.064405 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Domain-Name: None Aug 09 02:47:06.064405 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Identity-Status: Confirmed Aug 09 02:47:06.064405 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Is-Admin-Project: True Aug 09 02:47:06.064405 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Domain-Id: default Aug 09 02:47:06.064405 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Domain-Name: Default Aug 09 02:47:06.064405 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Id: 467b42c2bec74fcbbf90d007a6e00096 Aug 09 02:47:06.064405 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Name: tempest-AttachVolumeTestJSON-1583791890 Aug 09 02:47:06.064405 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Role: reader,member Aug 09 02:47:06.064405 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Roles: reader,member Aug 09 02:47:06.067083 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/467b42c2bec74fcbbf90d007a6e00096"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/467b42c2bec74fcbbf90d007a6e00096"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_467b42c2bec74fcbbf90d007a6e00096"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/467b42c2bec74fcbbf90d007a6e00096"}]}] Aug 09 02:47:06.067083 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant: tempest-AttachVolumeTestJSON-1583791890 Aug 09 02:47:06.067083 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant-Id: 467b42c2bec74fcbbf90d007a6e00096 Aug 09 02:47:06.067083 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1583791890 Aug 09 02:47:06.067083 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User: tempest-AttachVolumeTestJSON-1583791890-project Aug 09 02:47:06.067083 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Domain-Id: default Aug 09 02:47:06.067083 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Domain-Name: Default Aug 09 02:47:06.067083 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Id: 2aaa8a7f386e4ccc9ab5c356cdf1704f Aug 09 02:47:06.067083 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Name: tempest-AttachVolumeTestJSON-1583791890-project Aug 09 02:47:06.067083 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: method: > Aug 09 02:47:06.067083 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: exception: Instance 8f16a110-9dc8-4e95-b6de-c30feee35b89 could not be found. Aug 09 02:47:06.067083 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: action_args: {'id': '8f16a110-9dc8-4e95-b6de-c30feee35b89'} Aug 09 02:47:06.068588 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 02:47:06.068588 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:06.068588 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 02:47:06.068588 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 02:47:06.068588 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 02:47:06.068588 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 02:47:06.068588 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 02:47:06.068588 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 02:47:06.068588 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 02:47:06.068588 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 02:47:06.068588 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f16a110-9dc8-4e95-b6de-c30feee35b89 could not be found. Aug 09 02:47:06.068588 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:47:06.068588 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:47:06.068588 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:47:06.068588 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:06.068588 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:47:06.068588 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:47:06.068588 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 02:47:06.068588 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 02:47:06.068588 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 02:47:06.071144 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 02:47:06.071144 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 02:47:06.071144 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 02:47:06.071144 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 02:47:06.071144 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 02:47:06.071144 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 02:47:06.071144 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 02:47:06.071144 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 02:47:06.071144 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 02:47:06.071144 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f16a110-9dc8-4e95-b6de-c30feee35b89 could not be found. Aug 09 02:47:06.071144 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:47:06.071144 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:47:06.071144 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:47:06.071144 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:06.071144 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:47:06.071144 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:47:06.071144 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 02:47:06.071144 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 02:47:06.071144 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f16a110-9dc8-4e95-b6de-c30feee35b89 could not be found. Aug 09 02:47:06.071144 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:47:06.074136 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-2b04646a-fdd7-4ae7-83a2-0e69abd17ead tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Returning 404 to user: Instance 8f16a110-9dc8-4e95-b6de-c30feee35b89 could not be found. {{(pid=124425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 02:47:06.074136 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-2b04646a-fdd7-4ae7-83a2-0e69abd17ead tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 404 len: 111 microversion: 2.1 time: 0.030862 Aug 09 02:47:06.074136 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 425/872] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 9 02:47:06 2022] DELETE /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 02:47:06.074604 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-59ccfff5-61be-49f4-8d29-f6b65a7603fc tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:06.076682 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-c71be3e5-1524-4350-abad-2297f9cb8677 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:06.078141 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-c71be3e5-1524-4350-abad-2297f9cb8677 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] [instance: 8f16a110-9dc8-4e95-b6de-c30feee35b89] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:47:06.082032 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-59ccfff5-61be-49f4-8d29-f6b65a7603fc tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:06.083586 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-59ccfff5-61be-49f4-8d29-f6b65a7603fc tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:06.084776 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-59ccfff5-61be-49f4-8d29-f6b65a7603fc tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 200 len: 1720 microversion: 2.20 time: 0.233633 Aug 09 02:47:06.084951 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c71be3e5-1524-4350-abad-2297f9cb8677 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:06.085350 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 448/873] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:47:05 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 1720 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:47:06.085875 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c71be3e5-1524-4350-abad-2297f9cb8677 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:06.086744 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c71be3e5-1524-4350-abad-2297f9cb8677 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:06.087463 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c71be3e5-1524-4350-abad-2297f9cb8677 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:06.088117 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c71be3e5-1524-4350-abad-2297f9cb8677 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:06.088548 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c71be3e5-1524-4350-abad-2297f9cb8677 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:06.102908 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.wsgi [None req-c71be3e5-1524-4350-abad-2297f9cb8677 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] HTTP exception thrown: Instance 8f16a110-9dc8-4e95-b6de-c30feee35b89 could not be found. Aug 09 02:47:06.104460 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-c71be3e5-1524-4350-abad-2297f9cb8677 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Request method failure captured: Aug 09 02:47:06.104460 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: request: GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 HTTP/1.1 Aug 09 02:47:06.104460 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Accept: application/json Aug 09 02:47:06.104460 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Accept-Encoding: identity Aug 09 02:47:06.104460 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Connection: close Aug 09 02:47:06.104460 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Content-Length: 0 Aug 09 02:47:06.104460 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Content-Type: application/json Aug 09 02:47:06.104460 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Host: 10.222.0.20 Aug 09 02:47:06.104460 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Openstack-System-Scope: None Aug 09 02:47:06.104460 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: User-Agent: python-urllib3/1.26.11 Aug 09 02:47:06.104460 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Auth-Token: gAAAAABi8ckyQ7BoJhOISZ_aEyRwvtOf6wBg9xUi9Vu7KodpYSACalrsvz2rvL1C_mIOt-qr3Bi3jUgZqn7iqf0560XT8zZG6jy4ZTCN9qg5QZL2v5rqXFvpy1e6ziUjE1jR1eQoZ7H0yZm_ukrqaTXnceGFTdwFzKa-RsIlRVyuWjAiXqqozsE Aug 09 02:47:06.104460 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Domain-Id: None Aug 09 02:47:06.104460 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Domain-Name: None Aug 09 02:47:06.104460 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Identity-Status: Confirmed Aug 09 02:47:06.104460 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Is-Admin-Project: True Aug 09 02:47:06.104460 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Domain-Id: default Aug 09 02:47:06.104460 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Domain-Name: Default Aug 09 02:47:06.104460 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Id: 467b42c2bec74fcbbf90d007a6e00096 Aug 09 02:47:06.104460 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Name: tempest-AttachVolumeTestJSON-1583791890 Aug 09 02:47:06.104460 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Role: reader,member Aug 09 02:47:06.104460 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Roles: reader,member Aug 09 02:47:06.106084 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/467b42c2bec74fcbbf90d007a6e00096"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/467b42c2bec74fcbbf90d007a6e00096"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_467b42c2bec74fcbbf90d007a6e00096"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/467b42c2bec74fcbbf90d007a6e00096"}]}] Aug 09 02:47:06.106084 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant: tempest-AttachVolumeTestJSON-1583791890 Aug 09 02:47:06.106084 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant-Id: 467b42c2bec74fcbbf90d007a6e00096 Aug 09 02:47:06.106084 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1583791890 Aug 09 02:47:06.106084 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User: tempest-AttachVolumeTestJSON-1583791890-project Aug 09 02:47:06.106084 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Domain-Id: default Aug 09 02:47:06.106084 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Domain-Name: Default Aug 09 02:47:06.106084 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Id: 2aaa8a7f386e4ccc9ab5c356cdf1704f Aug 09 02:47:06.106084 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Name: tempest-AttachVolumeTestJSON-1583791890-project Aug 09 02:47:06.106084 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: method: > Aug 09 02:47:06.106084 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: exception: Instance 8f16a110-9dc8-4e95-b6de-c30feee35b89 could not be found. Aug 09 02:47:06.106084 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: action_args: {'id': '8f16a110-9dc8-4e95-b6de-c30feee35b89'} Aug 09 02:47:06.107024 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 02:47:06.107024 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:06.107024 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 02:47:06.107024 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 02:47:06.107024 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 02:47:06.107024 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 02:47:06.107024 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 02:47:06.107024 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 02:47:06.107024 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 02:47:06.107024 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 02:47:06.107024 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f16a110-9dc8-4e95-b6de-c30feee35b89 could not be found. Aug 09 02:47:06.107024 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:47:06.107024 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:47:06.107024 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:47:06.107024 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:06.107024 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:47:06.107024 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:47:06.107024 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 02:47:06.107024 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 02:47:06.107024 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 02:47:06.108429 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 02:47:06.108429 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 02:47:06.108429 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 02:47:06.108429 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 02:47:06.108429 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 02:47:06.108429 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 02:47:06.108429 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 02:47:06.108429 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f16a110-9dc8-4e95-b6de-c30feee35b89 could not be found. Aug 09 02:47:06.108429 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:47:06.108429 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:47:06.108429 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:47:06.108429 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:06.108429 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:47:06.108429 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:47:06.108429 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 02:47:06.108429 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 02:47:06.108429 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f16a110-9dc8-4e95-b6de-c30feee35b89 could not be found. Aug 09 02:47:06.108429 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:47:06.110036 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-c71be3e5-1524-4350-abad-2297f9cb8677 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] Returning 404 to user: Instance 8f16a110-9dc8-4e95-b6de-c30feee35b89 could not be found. {{(pid=124425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 02:47:06.110036 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-c71be3e5-1524-4350-abad-2297f9cb8677 tempest-AttachVolumeTestJSON-1583791890 tempest-AttachVolumeTestJSON-1583791890-project] 10.222.0.20 "GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89" status: 404 len: 111 microversion: 2.1 time: 0.034353 Aug 09 02:47:06.110036 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 426/874] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:47:06 2022] GET /compute/v2.1/servers/8f16a110-9dc8-4e95-b6de-c30feee35b89 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 02:47:07.107758 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-5d7e4ad9-9c91-4002-9a68-65630aa543ee tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:07.108358 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-5d7e4ad9-9c91-4002-9a68-65630aa543ee tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:47:07.112000 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:47:07.116586 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5d7e4ad9-9c91-4002-9a68-65630aa543ee tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:07.117074 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5d7e4ad9-9c91-4002-9a68-65630aa543ee tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:07.117511 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5d7e4ad9-9c91-4002-9a68-65630aa543ee tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:07.118333 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5d7e4ad9-9c91-4002-9a68-65630aa543ee tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:07.118685 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5d7e4ad9-9c91-4002-9a68-65630aa543ee tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:07.119172 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5d7e4ad9-9c91-4002-9a68-65630aa543ee tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:07.360702 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-5d7e4ad9-9c91-4002-9a68-65630aa543ee tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:07.374318 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-5d7e4ad9-9c91-4002-9a68-65630aa543ee tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:07.376292 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-5d7e4ad9-9c91-4002-9a68-65630aa543ee tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:07.377926 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-5d7e4ad9-9c91-4002-9a68-65630aa543ee tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 200 len: 1720 microversion: 2.20 time: 0.273971 Aug 09 02:47:07.378733 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 449/875] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:47:07 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 1720 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:47:08.403705 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-0842e8a9-64d4-4b55-8bf0-92e7abdd4a75 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:08.405589 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-0842e8a9-64d4-4b55-8bf0-92e7abdd4a75 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:47:08.413677 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0842e8a9-64d4-4b55-8bf0-92e7abdd4a75 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:08.414174 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0842e8a9-64d4-4b55-8bf0-92e7abdd4a75 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:08.414888 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0842e8a9-64d4-4b55-8bf0-92e7abdd4a75 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:08.415759 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0842e8a9-64d4-4b55-8bf0-92e7abdd4a75 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:08.416355 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0842e8a9-64d4-4b55-8bf0-92e7abdd4a75 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:08.416984 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0842e8a9-64d4-4b55-8bf0-92e7abdd4a75 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:08.701453 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-0842e8a9-64d4-4b55-8bf0-92e7abdd4a75 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:08.714139 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-0842e8a9-64d4-4b55-8bf0-92e7abdd4a75 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:08.714139 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-0842e8a9-64d4-4b55-8bf0-92e7abdd4a75 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:08.714139 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-0842e8a9-64d4-4b55-8bf0-92e7abdd4a75 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 200 len: 1720 microversion: 2.20 time: 0.315598 Aug 09 02:47:08.714838 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 427/876] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:47:08 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 1720 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:47:09.747914 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-bcdb07be-00e2-4918-8b2c-452da7923177 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:09.748544 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-bcdb07be-00e2-4918-8b2c-452da7923177 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:47:09.762385 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-bcdb07be-00e2-4918-8b2c-452da7923177 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:09.763268 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-bcdb07be-00e2-4918-8b2c-452da7923177 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:09.764002 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-bcdb07be-00e2-4918-8b2c-452da7923177 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:09.765264 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-bcdb07be-00e2-4918-8b2c-452da7923177 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:09.765886 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-bcdb07be-00e2-4918-8b2c-452da7923177 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:09.768414 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-bcdb07be-00e2-4918-8b2c-452da7923177 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:10.003895 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-bcdb07be-00e2-4918-8b2c-452da7923177 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:10.013217 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-bcdb07be-00e2-4918-8b2c-452da7923177 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:10.015143 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-bcdb07be-00e2-4918-8b2c-452da7923177 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:10.016695 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-bcdb07be-00e2-4918-8b2c-452da7923177 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 200 len: 1720 microversion: 2.20 time: 0.281475 Aug 09 02:47:10.017365 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 450/877] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:47:09 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 1720 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:47:11.029751 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-80e1c9ce-2f28-4f64-8be0-b131dc5dd7b2 tempest-VolumesSnapshotsTestJSON-1696348132 tempest-VolumesSnapshotsTestJSON-1696348132-project] Action: 'create', calling method: .version_select at 0x7fb0a041ee50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-709126132"}} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:47:11.056113 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-3fc4875e-38ab-44a5-86f5-352c90840728 tempest-VolumesNegativeTest-57807228 tempest-VolumesNegativeTest-57807228-project] Action: 'create', calling method: .version_select at 0x7fb0a039e550>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1667321317", "metadata": {"Type": "work"}}} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:47:11.068108 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-3fc4875e-38ab-44a5-86f5-352c90840728 tempest-VolumesNegativeTest-57807228 tempest-VolumesNegativeTest-57807228-project] Request method failure captured: Aug 09 02:47:11.068108 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 09 02:47:11.068108 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Accept: application/json Aug 09 02:47:11.068108 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Accept-Encoding: identity Aug 09 02:47:11.068108 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Connection: close Aug 09 02:47:11.068108 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Content-Length: 122 Aug 09 02:47:11.068108 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Content-Type: application/json Aug 09 02:47:11.068108 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Host: 10.222.0.20 Aug 09 02:47:11.068108 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Openstack-System-Scope: None Aug 09 02:47:11.068108 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: User-Agent: python-urllib3/1.26.11 Aug 09 02:47:11.068108 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Auth-Token: gAAAAABi8cquQSN9M2BkJeVv-Zw_Eb9oi8S2Myx7cUpDvRYnU1r8H1o2eSxqVp38jEpnoOuI7ZK8iYFkhfnhsRXAemjNw4DwIq1P6bqET9aWoJCtaEed1QNzk1OjsAwbBO2WsevFlorjIgHKoXUMGRbyklWureIWx1RCHSfzSnSVhfIFuYMpqd4 Aug 09 02:47:11.068108 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Domain-Id: None Aug 09 02:47:11.068108 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Domain-Name: None Aug 09 02:47:11.068108 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Identity-Status: Confirmed Aug 09 02:47:11.068108 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Is-Admin-Project: True Aug 09 02:47:11.068108 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Domain-Id: default Aug 09 02:47:11.068108 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Domain-Name: Default Aug 09 02:47:11.068108 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Id: 1ec3db1789a249459770141ece7f9e60 Aug 09 02:47:11.068108 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Name: tempest-VolumesNegativeTest-57807228 Aug 09 02:47:11.068108 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Role: reader,member Aug 09 02:47:11.068108 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Roles: reader,member Aug 09 02:47:11.070006 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1ec3db1789a249459770141ece7f9e60"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1ec3db1789a249459770141ece7f9e60"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1ec3db1789a249459770141ece7f9e60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1ec3db1789a249459770141ece7f9e60"}]}] Aug 09 02:47:11.070006 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant: tempest-VolumesNegativeTest-57807228 Aug 09 02:47:11.070006 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant-Id: 1ec3db1789a249459770141ece7f9e60 Aug 09 02:47:11.070006 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant-Name: tempest-VolumesNegativeTest-57807228 Aug 09 02:47:11.070006 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User: tempest-VolumesNegativeTest-57807228-project Aug 09 02:47:11.070006 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Domain-Id: default Aug 09 02:47:11.070006 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Domain-Name: Default Aug 09 02:47:11.070006 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Id: 4fe680af4dff41d8ae2680cc84aa01d1 Aug 09 02:47:11.070006 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Name: tempest-VolumesNegativeTest-57807228-project Aug 09 02:47:11.070006 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Aug 09 02:47:11.070006 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1667321317", "metadata": {"Type": "work"}}} Aug 09 02:47:11.070006 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: method: Aug 09 02:47:11.070006 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 09 02:47:11.071117 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1667321317', 'metadata': {'Type': 'work'}}}} Aug 09 02:47:11.071117 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 02:47:11.071117 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:11.071117 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 02:47:11.071117 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 02:47:11.071117 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 02:47:11.071117 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise error Aug 09 02:47:11.071117 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 09 02:47:11.071117 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:11.071117 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 09 02:47:11.071117 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 09 02:47:11.071117 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:11.071117 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 09 02:47:11.071117 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi '#$%' Aug 09 02:47:11.071117 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:11.071117 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:47:11.071117 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:11.071117 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:11.071117 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:47:11.071117 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:47:11.071117 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 02:47:11.071117 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 02:47:11.072497 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 02:47:11.072497 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 02:47:11.072497 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 02:47:11.072497 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 02:47:11.072497 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 02:47:11.072497 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 02:47:11.072497 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 02:47:11.072497 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 02:47:11.072497 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 02:47:11.072497 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 02:47:11.072497 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 09 02:47:11.072497 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:11.072497 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:47:11.072497 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:11.072497 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:11.072497 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:47:11.072497 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:47:11.072497 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 02:47:11.072497 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 02:47:11.074395 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 09 02:47:11.074395 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:11.074395 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-3fc4875e-38ab-44a5-86f5-352c90840728 tempest-VolumesNegativeTest-57807228 tempest-VolumesNegativeTest-57807228-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124427) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 02:47:11.074395 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-3fc4875e-38ab-44a5-86f5-352c90840728 tempest-VolumesNegativeTest-57807228 tempest-VolumesNegativeTest-57807228-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.127363 Aug 09 02:47:11.074395 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 451/878] 10.222.0.20 () {60 vars in 1156 bytes} [Tue Aug 9 02:47:10 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 129 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 02:47:11.076717 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-7aba4ded-b11a-401e-848e-f6078e132e4b tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:11.077332 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-7aba4ded-b11a-401e-848e-f6078e132e4b tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:47:11.084577 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7aba4ded-b11a-401e-848e-f6078e132e4b tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:11.085068 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7aba4ded-b11a-401e-848e-f6078e132e4b tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:11.085500 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7aba4ded-b11a-401e-848e-f6078e132e4b tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:11.086246 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7aba4ded-b11a-401e-848e-f6078e132e4b tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:11.086669 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7aba4ded-b11a-401e-848e-f6078e132e4b tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:11.087092 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-7aba4ded-b11a-401e-848e-f6078e132e4b tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:11.221854 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-7aba4ded-b11a-401e-848e-f6078e132e4b tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:11.230295 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-7aba4ded-b11a-401e-848e-f6078e132e4b tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:11.231792 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-7aba4ded-b11a-401e-848e-f6078e132e4b tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:11.232960 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-7aba4ded-b11a-401e-848e-f6078e132e4b tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 200 len: 1720 microversion: 2.20 time: 0.161169 Aug 09 02:47:11.233520 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 452/879] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:47:11 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:47:11.238461 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-7da2b507-c5cf-494d-aa50-1468a9c5be2d tempest-VolumesNegativeTest-57807228 tempest-VolumesNegativeTest-57807228-project] Action: 'create', calling method: .version_select at 0x7fb0a0307d30>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2030941564", "metadata": {"Type": "work"}}} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:47:11.242141 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-7da2b507-c5cf-494d-aa50-1468a9c5be2d tempest-VolumesNegativeTest-57807228 tempest-VolumesNegativeTest-57807228-project] Request method failure captured: Aug 09 02:47:11.242141 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 09 02:47:11.242141 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Accept: application/json Aug 09 02:47:11.242141 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Accept-Encoding: identity Aug 09 02:47:11.242141 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Connection: close Aug 09 02:47:11.242141 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Content-Length: 120 Aug 09 02:47:11.242141 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Content-Type: application/json Aug 09 02:47:11.242141 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Host: 10.222.0.20 Aug 09 02:47:11.242141 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Openstack-System-Scope: None Aug 09 02:47:11.242141 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: User-Agent: python-urllib3/1.26.11 Aug 09 02:47:11.242141 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Auth-Token: gAAAAABi8cquQSN9M2BkJeVv-Zw_Eb9oi8S2Myx7cUpDvRYnU1r8H1o2eSxqVp38jEpnoOuI7ZK8iYFkhfnhsRXAemjNw4DwIq1P6bqET9aWoJCtaEed1QNzk1OjsAwbBO2WsevFlorjIgHKoXUMGRbyklWureIWx1RCHSfzSnSVhfIFuYMpqd4 Aug 09 02:47:11.242141 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Domain-Id: None Aug 09 02:47:11.242141 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Domain-Name: None Aug 09 02:47:11.242141 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Identity-Status: Confirmed Aug 09 02:47:11.242141 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Is-Admin-Project: True Aug 09 02:47:11.242141 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Domain-Id: default Aug 09 02:47:11.242141 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Domain-Name: Default Aug 09 02:47:11.242141 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Id: 1ec3db1789a249459770141ece7f9e60 Aug 09 02:47:11.242141 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Name: tempest-VolumesNegativeTest-57807228 Aug 09 02:47:11.242141 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Role: reader,member Aug 09 02:47:11.242141 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Roles: reader,member Aug 09 02:47:11.243586 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1ec3db1789a249459770141ece7f9e60"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1ec3db1789a249459770141ece7f9e60"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1ec3db1789a249459770141ece7f9e60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1ec3db1789a249459770141ece7f9e60"}]}] Aug 09 02:47:11.243586 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant: tempest-VolumesNegativeTest-57807228 Aug 09 02:47:11.243586 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant-Id: 1ec3db1789a249459770141ece7f9e60 Aug 09 02:47:11.243586 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant-Name: tempest-VolumesNegativeTest-57807228 Aug 09 02:47:11.243586 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User: tempest-VolumesNegativeTest-57807228-project Aug 09 02:47:11.243586 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Domain-Id: default Aug 09 02:47:11.243586 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Domain-Name: Default Aug 09 02:47:11.243586 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Id: 4fe680af4dff41d8ae2680cc84aa01d1 Aug 09 02:47:11.243586 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Name: tempest-VolumesNegativeTest-57807228-project Aug 09 02:47:11.243586 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Aug 09 02:47:11.243586 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2030941564", "metadata": {"Type": "work"}}} Aug 09 02:47:11.243586 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: method: Aug 09 02:47:11.243586 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 09 02:47:11.244442 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2030941564', 'metadata': {'Type': 'work'}}}} Aug 09 02:47:11.244442 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 02:47:11.244442 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:11.244442 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 02:47:11.244442 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 02:47:11.244442 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 02:47:11.244442 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise error Aug 09 02:47:11.244442 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 09 02:47:11.244442 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:11.244442 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 09 02:47:11.244442 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 09 02:47:11.244442 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:11.244442 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 09 02:47:11.244442 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi '0' Aug 09 02:47:11.244442 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:11.244442 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:47:11.244442 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:11.244442 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:11.244442 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:47:11.244442 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:47:11.244442 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 02:47:11.244442 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 02:47:11.245810 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 02:47:11.245810 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 02:47:11.245810 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 02:47:11.245810 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 02:47:11.245810 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 02:47:11.245810 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 02:47:11.245810 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 02:47:11.245810 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 02:47:11.245810 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 02:47:11.245810 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 02:47:11.245810 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 09 02:47:11.245810 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:11.245810 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:47:11.245810 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:11.245810 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:11.245810 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:47:11.245810 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:47:11.245810 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 02:47:11.245810 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 02:47:11.247020 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 09 02:47:11.247020 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:11.247020 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-7da2b507-c5cf-494d-aa50-1468a9c5be2d tempest-VolumesNegativeTest-57807228 tempest-VolumesNegativeTest-57807228-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124427) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 02:47:11.247020 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-7da2b507-c5cf-494d-aa50-1468a9c5be2d tempest-VolumesNegativeTest-57807228 tempest-VolumesNegativeTest-57807228-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009135 Aug 09 02:47:11.247020 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 453/880] 10.222.0.20 () {60 vars in 1156 bytes} [Tue Aug 9 02:47:11 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 02:47:11.254920 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-bcf368f1-babd-425c-952e-f3da85174fb2 tempest-VolumesNegativeTest-57807228 tempest-VolumesNegativeTest-57807228-project] Action: 'create', calling method: .version_select at 0x7fb0a02ff820>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-621810015", "metadata": {"Type": "work"}}} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:47:11.258416 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-bcf368f1-babd-425c-952e-f3da85174fb2 tempest-VolumesNegativeTest-57807228 tempest-VolumesNegativeTest-57807228-project] Request method failure captured: Aug 09 02:47:11.258416 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 09 02:47:11.258416 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Accept: application/json Aug 09 02:47:11.258416 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Accept-Encoding: identity Aug 09 02:47:11.258416 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Connection: close Aug 09 02:47:11.258416 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Content-Length: 118 Aug 09 02:47:11.258416 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Content-Type: application/json Aug 09 02:47:11.258416 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Host: 10.222.0.20 Aug 09 02:47:11.258416 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Openstack-System-Scope: None Aug 09 02:47:11.258416 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: User-Agent: python-urllib3/1.26.11 Aug 09 02:47:11.258416 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Auth-Token: gAAAAABi8cquQSN9M2BkJeVv-Zw_Eb9oi8S2Myx7cUpDvRYnU1r8H1o2eSxqVp38jEpnoOuI7ZK8iYFkhfnhsRXAemjNw4DwIq1P6bqET9aWoJCtaEed1QNzk1OjsAwbBO2WsevFlorjIgHKoXUMGRbyklWureIWx1RCHSfzSnSVhfIFuYMpqd4 Aug 09 02:47:11.258416 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Domain-Id: None Aug 09 02:47:11.258416 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Domain-Name: None Aug 09 02:47:11.258416 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Identity-Status: Confirmed Aug 09 02:47:11.258416 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Is-Admin-Project: True Aug 09 02:47:11.258416 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Domain-Id: default Aug 09 02:47:11.258416 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Domain-Name: Default Aug 09 02:47:11.258416 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Id: 1ec3db1789a249459770141ece7f9e60 Aug 09 02:47:11.258416 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Name: tempest-VolumesNegativeTest-57807228 Aug 09 02:47:11.258416 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Role: reader,member Aug 09 02:47:11.258416 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Roles: reader,member Aug 09 02:47:11.259786 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1ec3db1789a249459770141ece7f9e60"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1ec3db1789a249459770141ece7f9e60"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1ec3db1789a249459770141ece7f9e60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1ec3db1789a249459770141ece7f9e60"}]}] Aug 09 02:47:11.259786 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant: tempest-VolumesNegativeTest-57807228 Aug 09 02:47:11.259786 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant-Id: 1ec3db1789a249459770141ece7f9e60 Aug 09 02:47:11.259786 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant-Name: tempest-VolumesNegativeTest-57807228 Aug 09 02:47:11.259786 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User: tempest-VolumesNegativeTest-57807228-project Aug 09 02:47:11.259786 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Domain-Id: default Aug 09 02:47:11.259786 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Domain-Name: Default Aug 09 02:47:11.259786 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Id: 4fe680af4dff41d8ae2680cc84aa01d1 Aug 09 02:47:11.259786 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Name: tempest-VolumesNegativeTest-57807228-project Aug 09 02:47:11.259786 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Aug 09 02:47:11.259786 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-621810015", "metadata": {"Type": "work"}}} Aug 09 02:47:11.259786 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: method: Aug 09 02:47:11.259786 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 09 02:47:11.260792 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-621810015', 'metadata': {'Type': 'work'}}}} Aug 09 02:47:11.260792 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 02:47:11.260792 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:11.260792 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 02:47:11.260792 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 02:47:11.260792 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 02:47:11.260792 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise error Aug 09 02:47:11.260792 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 09 02:47:11.260792 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:11.260792 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 09 02:47:11.260792 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 09 02:47:11.260792 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:11.260792 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 09 02:47:11.260792 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi '' Aug 09 02:47:11.260792 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:11.260792 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:47:11.260792 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:11.260792 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:11.260792 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:47:11.260792 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:47:11.260792 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 02:47:11.260792 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 02:47:11.262329 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 02:47:11.262329 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 02:47:11.262329 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 02:47:11.262329 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 02:47:11.262329 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 02:47:11.262329 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 02:47:11.262329 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 02:47:11.262329 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 02:47:11.262329 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 02:47:11.262329 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 02:47:11.262329 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 09 02:47:11.262329 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:11.262329 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:47:11.262329 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:11.262329 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:11.262329 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:47:11.262329 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:47:11.262329 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 02:47:11.262329 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 02:47:11.263554 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 09 02:47:11.263554 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:11.263554 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-bcf368f1-babd-425c-952e-f3da85174fb2 tempest-VolumesNegativeTest-57807228 tempest-VolumesNegativeTest-57807228-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124427) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 02:47:11.263554 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-bcf368f1-babd-425c-952e-f3da85174fb2 tempest-VolumesNegativeTest-57807228 tempest-VolumesNegativeTest-57807228-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008456 Aug 09 02:47:11.263554 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 454/881] 10.222.0.20 () {60 vars in 1156 bytes} [Tue Aug 9 02:47:11 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 09 02:47:11.270908 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-7d5b9d5c-d94c-4b74-8618-fcd5016a4e68 tempest-VolumesNegativeTest-57807228 tempest-VolumesNegativeTest-57807228-project] Calling method '.version_select at 0x7fb0a02739d0>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:11.305393 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.wsgi [None req-7d5b9d5c-d94c-4b74-8618-fcd5016a4e68 tempest-VolumesNegativeTest-57807228 tempest-VolumesNegativeTest-57807228-project] HTTP exception thrown: Volume tempest-invalid-939739168 could not be found. Aug 09 02:47:11.309545 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-7d5b9d5c-d94c-4b74-8618-fcd5016a4e68 tempest-VolumesNegativeTest-57807228 tempest-VolumesNegativeTest-57807228-project] Request method failure captured: Aug 09 02:47:11.309545 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-939739168 HTTP/1.1 Aug 09 02:47:11.309545 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Accept: application/json Aug 09 02:47:11.309545 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Accept-Encoding: identity Aug 09 02:47:11.309545 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Connection: close Aug 09 02:47:11.309545 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Content-Length: 0 Aug 09 02:47:11.309545 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Content-Type: application/json Aug 09 02:47:11.309545 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Host: 10.222.0.20 Aug 09 02:47:11.309545 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Openstack-System-Scope: None Aug 09 02:47:11.309545 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: User-Agent: python-urllib3/1.26.11 Aug 09 02:47:11.309545 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Auth-Token: gAAAAABi8cquQSN9M2BkJeVv-Zw_Eb9oi8S2Myx7cUpDvRYnU1r8H1o2eSxqVp38jEpnoOuI7ZK8iYFkhfnhsRXAemjNw4DwIq1P6bqET9aWoJCtaEed1QNzk1OjsAwbBO2WsevFlorjIgHKoXUMGRbyklWureIWx1RCHSfzSnSVhfIFuYMpqd4 Aug 09 02:47:11.309545 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Domain-Id: None Aug 09 02:47:11.309545 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Domain-Name: None Aug 09 02:47:11.309545 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Identity-Status: Confirmed Aug 09 02:47:11.309545 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Is-Admin-Project: True Aug 09 02:47:11.309545 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Domain-Id: default Aug 09 02:47:11.309545 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Domain-Name: Default Aug 09 02:47:11.309545 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Id: 1ec3db1789a249459770141ece7f9e60 Aug 09 02:47:11.309545 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Name: tempest-VolumesNegativeTest-57807228 Aug 09 02:47:11.309545 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Role: reader,member Aug 09 02:47:11.309545 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Roles: reader,member Aug 09 02:47:11.311162 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1ec3db1789a249459770141ece7f9e60"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1ec3db1789a249459770141ece7f9e60"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1ec3db1789a249459770141ece7f9e60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1ec3db1789a249459770141ece7f9e60"}]}] Aug 09 02:47:11.311162 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant: tempest-VolumesNegativeTest-57807228 Aug 09 02:47:11.311162 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant-Id: 1ec3db1789a249459770141ece7f9e60 Aug 09 02:47:11.311162 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant-Name: tempest-VolumesNegativeTest-57807228 Aug 09 02:47:11.311162 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User: tempest-VolumesNegativeTest-57807228-project Aug 09 02:47:11.311162 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Domain-Id: default Aug 09 02:47:11.311162 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Domain-Name: Default Aug 09 02:47:11.311162 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Id: 4fe680af4dff41d8ae2680cc84aa01d1 Aug 09 02:47:11.311162 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Name: tempest-VolumesNegativeTest-57807228-project Aug 09 02:47:11.311162 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: method: Aug 09 02:47:11.311162 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: exception: Volume tempest-invalid-939739168 could not be found. Aug 09 02:47:11.311162 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: action_args: {'id': 'tempest-invalid-939739168'} Aug 09 02:47:11.311162 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 02:47:11.312005 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:11.312005 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 02:47:11.312005 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 02:47:11.312005 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 02:47:11.312005 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 02:47:11.312005 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 02:47:11.312005 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 02:47:11.312005 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 02:47:11.312005 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 02:47:11.312005 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 02:47:11.312005 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 02:47:11.312005 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 02:47:11.312005 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 02:47:11.312005 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 02:47:11.312005 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 02:47:11.312005 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-939739168 could not be found. (HTTP 404) (Request-ID: req-0f906125-a688-4f94-93bf-8ddc0df3adf0) Aug 09 02:47:11.312005 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:11.312005 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:47:11.312005 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:11.313240 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:11.313240 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 09 02:47:11.313240 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 09 02:47:11.313240 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 02:47:11.313240 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 02:47:11.313240 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 02:47:11.313240 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 02:47:11.313240 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 02:47:11.313240 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 02:47:11.313240 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 02:47:11.313240 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 02:47:11.313240 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 02:47:11.313240 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 02:47:11.313240 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 02:47:11.313240 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 02:47:11.313240 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 02:47:11.313240 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 02:47:11.313240 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 02:47:11.313240 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 02:47:11.315693 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 02:47:11.315693 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 02:47:11.315693 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 02:47:11.315693 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 02:47:11.315693 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-939739168 could not be found. Aug 09 02:47:11.315693 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:11.315693 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:47:11.315693 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:11.315693 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:11.315693 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:47:11.315693 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:47:11.315693 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 02:47:11.315693 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 02:47:11.315693 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 02:47:11.315693 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 02:47:11.315693 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 02:47:11.315693 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 02:47:11.315693 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 09 02:47:11.315693 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 02:47:11.315693 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-939739168 could not be found. Aug 09 02:47:11.318848 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:11.318848 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:47:11.318848 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:11.318848 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:11.318848 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:47:11.318848 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:47:11.318848 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 02:47:11.318848 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 02:47:11.318848 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-939739168 could not be found. Aug 09 02:47:11.318848 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:11.318848 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-7d5b9d5c-d94c-4b74-8618-fcd5016a4e68 tempest-VolumesNegativeTest-57807228 tempest-VolumesNegativeTest-57807228-project] Returning 404 to user: Volume tempest-invalid-939739168 could not be found. {{(pid=124427) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 02:47:11.318848 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-7d5b9d5c-d94c-4b74-8618-fcd5016a4e68 tempest-VolumesNegativeTest-57807228 tempest-VolumesNegativeTest-57807228-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/tempest-invalid-939739168" status: 404 len: 98 microversion: 2.1 time: 0.043727 Aug 09 02:47:11.318848 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 455/882] 10.222.0.20 () {58 vars in 1215 bytes} [Tue Aug 9 02:47:11 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-939739168 => generated 98 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 02:47:11.324442 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-5f008893-e5f4-4b87-9322-d041ed7efc60 tempest-VolumesNegativeTest-57807228 tempest-VolumesNegativeTest-57807228-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004488 Aug 09 02:47:11.325106 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 456/883] 10.222.0.20 () {58 vars in 1140 bytes} [Tue Aug 9 02:47:11 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 09 02:47:11.332838 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-59ddcfba-05e3-4508-b7f9-b3877bea856a tempest-VolumesNegativeTest-57807228 tempest-VolumesNegativeTest-57807228-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003402 Aug 09 02:47:11.333530 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 457/884] 10.222.0.20 () {58 vars in 1137 bytes} [Tue Aug 9 02:47:11 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 09 02:47:11.341266 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-80e1c9ce-2f28-4f64-8be0-b131dc5dd7b2 tempest-VolumesSnapshotsTestJSON-1696348132 tempest-VolumesSnapshotsTestJSON-1696348132-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.425708 Aug 09 02:47:11.341882 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 428/885] 10.222.0.20 () {60 vars in 1155 bytes} [Tue Aug 9 02:47:10 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 427 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 09 02:47:11.346371 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-7bfa0f4f-e053-407f-b17e-b5b7d9b92807 tempest-VolumesNegativeTest-57807228 tempest-VolumesNegativeTest-57807228-project] Calling method '.version_select at 0x7fb0a03c5040>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:11.353790 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-64f67b2f-9ccc-463e-9892-f4af0b73187e tempest-VolumesSnapshotsTestJSON-1696348132 tempest-VolumesSnapshotsTestJSON-1696348132-project] Calling method '.version_select at 0x7fb0a04d00d0>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:11.382322 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.wsgi [None req-7bfa0f4f-e053-407f-b17e-b5b7d9b92807 tempest-VolumesNegativeTest-57807228 tempest-VolumesNegativeTest-57807228-project] HTTP exception thrown: Volume ea9a1248-2749-4023-9652-3e7b93f3c170 could not be found. Aug 09 02:47:11.384324 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-7bfa0f4f-e053-407f-b17e-b5b7d9b92807 tempest-VolumesNegativeTest-57807228 tempest-VolumesNegativeTest-57807228-project] Request method failure captured: Aug 09 02:47:11.384324 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: request: DELETE /compute/v2.1/os-volumes/ea9a1248-2749-4023-9652-3e7b93f3c170 HTTP/1.1 Aug 09 02:47:11.384324 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Accept: application/json Aug 09 02:47:11.384324 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Accept-Encoding: identity Aug 09 02:47:11.384324 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Connection: close Aug 09 02:47:11.384324 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Content-Length: 0 Aug 09 02:47:11.384324 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Content-Type: application/json Aug 09 02:47:11.384324 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Host: 10.222.0.20 Aug 09 02:47:11.384324 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Openstack-System-Scope: None Aug 09 02:47:11.384324 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: User-Agent: python-urllib3/1.26.11 Aug 09 02:47:11.384324 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Auth-Token: gAAAAABi8cquQSN9M2BkJeVv-Zw_Eb9oi8S2Myx7cUpDvRYnU1r8H1o2eSxqVp38jEpnoOuI7ZK8iYFkhfnhsRXAemjNw4DwIq1P6bqET9aWoJCtaEed1QNzk1OjsAwbBO2WsevFlorjIgHKoXUMGRbyklWureIWx1RCHSfzSnSVhfIFuYMpqd4 Aug 09 02:47:11.384324 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Domain-Id: None Aug 09 02:47:11.384324 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Domain-Name: None Aug 09 02:47:11.384324 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Identity-Status: Confirmed Aug 09 02:47:11.384324 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Is-Admin-Project: True Aug 09 02:47:11.384324 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Domain-Id: default Aug 09 02:47:11.384324 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Domain-Name: Default Aug 09 02:47:11.384324 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Id: 1ec3db1789a249459770141ece7f9e60 Aug 09 02:47:11.384324 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Name: tempest-VolumesNegativeTest-57807228 Aug 09 02:47:11.384324 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Role: reader,member Aug 09 02:47:11.384324 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Roles: reader,member Aug 09 02:47:11.385902 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1ec3db1789a249459770141ece7f9e60"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1ec3db1789a249459770141ece7f9e60"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1ec3db1789a249459770141ece7f9e60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1ec3db1789a249459770141ece7f9e60"}]}] Aug 09 02:47:11.385902 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant: tempest-VolumesNegativeTest-57807228 Aug 09 02:47:11.385902 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant-Id: 1ec3db1789a249459770141ece7f9e60 Aug 09 02:47:11.385902 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant-Name: tempest-VolumesNegativeTest-57807228 Aug 09 02:47:11.385902 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User: tempest-VolumesNegativeTest-57807228-project Aug 09 02:47:11.385902 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Domain-Id: default Aug 09 02:47:11.385902 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Domain-Name: Default Aug 09 02:47:11.385902 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Id: 4fe680af4dff41d8ae2680cc84aa01d1 Aug 09 02:47:11.385902 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Name: tempest-VolumesNegativeTest-57807228-project Aug 09 02:47:11.385902 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: method: Aug 09 02:47:11.385902 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: exception: Volume ea9a1248-2749-4023-9652-3e7b93f3c170 could not be found. Aug 09 02:47:11.385902 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: action_args: {'id': 'ea9a1248-2749-4023-9652-3e7b93f3c170'} Aug 09 02:47:11.385902 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 02:47:11.391048 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:11.391048 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 02:47:11.391048 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 02:47:11.391048 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 02:47:11.391048 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 02:47:11.391048 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 02:47:11.391048 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 02:47:11.391048 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 02:47:11.391048 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 02:47:11.391048 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 02:47:11.391048 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 02:47:11.391048 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 02:47:11.391048 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 02:47:11.391048 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 02:47:11.391048 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 02:47:11.391048 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ea9a1248-2749-4023-9652-3e7b93f3c170 could not be found. (HTTP 404) (Request-ID: req-e65c5891-59ad-4dab-8449-3822cbe3a23e) Aug 09 02:47:11.391048 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:11.391048 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:47:11.391048 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:11.392755 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:11.392755 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 09 02:47:11.392755 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 09 02:47:11.392755 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 02:47:11.392755 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 02:47:11.392755 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 02:47:11.392755 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 02:47:11.392755 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 02:47:11.392755 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 02:47:11.392755 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 02:47:11.392755 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 02:47:11.392755 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 02:47:11.392755 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 02:47:11.392755 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 02:47:11.392755 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 02:47:11.392755 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 02:47:11.392755 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 02:47:11.392755 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 02:47:11.392755 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 02:47:11.394262 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 02:47:11.394262 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 02:47:11.394262 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 02:47:11.394262 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 02:47:11.394262 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ea9a1248-2749-4023-9652-3e7b93f3c170 could not be found. Aug 09 02:47:11.394262 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:11.394262 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:47:11.394262 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:11.394262 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:11.394262 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:47:11.394262 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:47:11.394262 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 02:47:11.394262 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 02:47:11.394262 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 02:47:11.394262 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 02:47:11.394262 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 02:47:11.394262 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 02:47:11.394262 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 09 02:47:11.394262 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 02:47:11.395623 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ea9a1248-2749-4023-9652-3e7b93f3c170 could not be found. Aug 09 02:47:11.395623 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:11.395623 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:47:11.395623 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:11.395623 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:11.395623 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:47:11.395623 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:47:11.395623 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 02:47:11.395623 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 02:47:11.395623 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ea9a1248-2749-4023-9652-3e7b93f3c170 could not be found. Aug 09 02:47:11.395623 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:11.395623 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-7bfa0f4f-e053-407f-b17e-b5b7d9b92807 tempest-VolumesNegativeTest-57807228 tempest-VolumesNegativeTest-57807228-project] Returning 404 to user: Volume ea9a1248-2749-4023-9652-3e7b93f3c170 could not be found. {{(pid=124427) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 02:47:11.395623 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-7bfa0f4f-e053-407f-b17e-b5b7d9b92807 tempest-VolumesNegativeTest-57807228 tempest-VolumesNegativeTest-57807228-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/ea9a1248-2749-4023-9652-3e7b93f3c170" status: 404 len: 109 microversion: 2.1 time: 0.047583 Aug 09 02:47:11.395623 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 458/886] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Aug 9 02:47:11 2022] DELETE /compute/v2.1/os-volumes/ea9a1248-2749-4023-9652-3e7b93f3c170 => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 02:47:11.401335 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-21ea5dee-4ce7-4963-aaa3-09059dfcc234 tempest-VolumesNegativeTest-57807228 tempest-VolumesNegativeTest-57807228-project] Calling method '.version_select at 0x7fb0a027c550>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:11.414718 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-64f67b2f-9ccc-463e-9892-f4af0b73187e tempest-VolumesSnapshotsTestJSON-1696348132 tempest-VolumesSnapshotsTestJSON-1696348132-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/02e77b76-d359-4c33-8331-433d9e1e0e96" status: 200 len: 344 microversion: 2.1 time: 0.064213 Aug 09 02:47:11.415432 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 429/887] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Aug 9 02:47:11 2022] GET /compute/v2.1/os-volumes/02e77b76-d359-4c33-8331-433d9e1e0e96 => generated 344 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 02:47:11.434041 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.wsgi [None req-21ea5dee-4ce7-4963-aaa3-09059dfcc234 tempest-VolumesNegativeTest-57807228 tempest-VolumesNegativeTest-57807228-project] HTTP exception thrown: Volume ce1bc33f-a3ba-49a4-9651-466d197dde99 could not be found. Aug 09 02:47:11.436038 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-21ea5dee-4ce7-4963-aaa3-09059dfcc234 tempest-VolumesNegativeTest-57807228 tempest-VolumesNegativeTest-57807228-project] Request method failure captured: Aug 09 02:47:11.436038 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: request: GET /compute/v2.1/os-volumes/ce1bc33f-a3ba-49a4-9651-466d197dde99 HTTP/1.1 Aug 09 02:47:11.436038 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Accept: application/json Aug 09 02:47:11.436038 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Accept-Encoding: identity Aug 09 02:47:11.436038 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Connection: close Aug 09 02:47:11.436038 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Content-Length: 0 Aug 09 02:47:11.436038 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Content-Type: application/json Aug 09 02:47:11.436038 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Host: 10.222.0.20 Aug 09 02:47:11.436038 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Openstack-System-Scope: None Aug 09 02:47:11.436038 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: User-Agent: python-urllib3/1.26.11 Aug 09 02:47:11.436038 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Auth-Token: gAAAAABi8cquQSN9M2BkJeVv-Zw_Eb9oi8S2Myx7cUpDvRYnU1r8H1o2eSxqVp38jEpnoOuI7ZK8iYFkhfnhsRXAemjNw4DwIq1P6bqET9aWoJCtaEed1QNzk1OjsAwbBO2WsevFlorjIgHKoXUMGRbyklWureIWx1RCHSfzSnSVhfIFuYMpqd4 Aug 09 02:47:11.436038 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Domain-Id: None Aug 09 02:47:11.436038 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Domain-Name: None Aug 09 02:47:11.436038 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Identity-Status: Confirmed Aug 09 02:47:11.436038 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Is-Admin-Project: True Aug 09 02:47:11.436038 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Domain-Id: default Aug 09 02:47:11.436038 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Domain-Name: Default Aug 09 02:47:11.436038 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Id: 1ec3db1789a249459770141ece7f9e60 Aug 09 02:47:11.436038 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Name: tempest-VolumesNegativeTest-57807228 Aug 09 02:47:11.436038 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Role: reader,member Aug 09 02:47:11.436038 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Roles: reader,member Aug 09 02:47:11.437708 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1ec3db1789a249459770141ece7f9e60"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1ec3db1789a249459770141ece7f9e60"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1ec3db1789a249459770141ece7f9e60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1ec3db1789a249459770141ece7f9e60"}]}] Aug 09 02:47:11.437708 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant: tempest-VolumesNegativeTest-57807228 Aug 09 02:47:11.437708 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant-Id: 1ec3db1789a249459770141ece7f9e60 Aug 09 02:47:11.437708 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant-Name: tempest-VolumesNegativeTest-57807228 Aug 09 02:47:11.437708 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User: tempest-VolumesNegativeTest-57807228-project Aug 09 02:47:11.437708 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Domain-Id: default Aug 09 02:47:11.437708 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Domain-Name: Default Aug 09 02:47:11.437708 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Id: 4fe680af4dff41d8ae2680cc84aa01d1 Aug 09 02:47:11.437708 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Name: tempest-VolumesNegativeTest-57807228-project Aug 09 02:47:11.437708 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: method: Aug 09 02:47:11.437708 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: exception: Volume ce1bc33f-a3ba-49a4-9651-466d197dde99 could not be found. Aug 09 02:47:11.437708 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: action_args: {'id': 'ce1bc33f-a3ba-49a4-9651-466d197dde99'} Aug 09 02:47:11.437708 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 02:47:11.438870 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:11.438870 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 02:47:11.438870 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 02:47:11.438870 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 02:47:11.438870 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 02:47:11.438870 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 02:47:11.438870 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 02:47:11.438870 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 02:47:11.438870 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 02:47:11.438870 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 02:47:11.438870 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 02:47:11.438870 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 02:47:11.438870 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 02:47:11.438870 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 02:47:11.438870 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 02:47:11.438870 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ce1bc33f-a3ba-49a4-9651-466d197dde99 could not be found. (HTTP 404) (Request-ID: req-a4429a95-59a1-42e6-8229-51391a2aa67d) Aug 09 02:47:11.438870 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:11.438870 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:47:11.438870 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:11.440275 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:11.440275 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 09 02:47:11.440275 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 09 02:47:11.440275 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 02:47:11.440275 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 02:47:11.440275 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 02:47:11.440275 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 02:47:11.440275 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 02:47:11.440275 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 02:47:11.440275 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 02:47:11.440275 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 02:47:11.440275 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 02:47:11.440275 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 02:47:11.440275 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 02:47:11.440275 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 02:47:11.440275 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 02:47:11.440275 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 02:47:11.440275 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 02:47:11.440275 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 02:47:11.441656 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 02:47:11.441656 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 02:47:11.441656 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 02:47:11.441656 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 02:47:11.441656 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ce1bc33f-a3ba-49a4-9651-466d197dde99 could not be found. Aug 09 02:47:11.441656 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:11.441656 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:47:11.441656 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:11.441656 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:11.441656 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:47:11.441656 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:47:11.441656 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 02:47:11.441656 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 02:47:11.441656 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 02:47:11.441656 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 02:47:11.441656 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 02:47:11.441656 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 02:47:11.441656 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 09 02:47:11.441656 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 02:47:11.443089 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ce1bc33f-a3ba-49a4-9651-466d197dde99 could not be found. Aug 09 02:47:11.443089 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:11.443089 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:47:11.443089 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:11.443089 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:11.443089 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:47:11.443089 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:47:11.443089 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 02:47:11.443089 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 02:47:11.443089 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ce1bc33f-a3ba-49a4-9651-466d197dde99 could not be found. Aug 09 02:47:11.443089 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:11.443089 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-21ea5dee-4ce7-4963-aaa3-09059dfcc234 tempest-VolumesNegativeTest-57807228 tempest-VolumesNegativeTest-57807228-project] Returning 404 to user: Volume ce1bc33f-a3ba-49a4-9651-466d197dde99 could not be found. {{(pid=124427) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 02:47:11.443089 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-21ea5dee-4ce7-4963-aaa3-09059dfcc234 tempest-VolumesNegativeTest-57807228 tempest-VolumesNegativeTest-57807228-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/ce1bc33f-a3ba-49a4-9651-466d197dde99" status: 404 len: 109 microversion: 2.1 time: 0.045896 Aug 09 02:47:11.443089 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 459/888] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Aug 9 02:47:11 2022] GET /compute/v2.1/os-volumes/ce1bc33f-a3ba-49a4-9651-466d197dde99 => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 02:47:12.256620 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-bcbff0e8-2e00-4656-a2ba-ec770dbe5d60 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:12.257215 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-bcbff0e8-2e00-4656-a2ba-ec770dbe5d60 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:47:12.264225 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-bcbff0e8-2e00-4656-a2ba-ec770dbe5d60 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:12.264799 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-bcbff0e8-2e00-4656-a2ba-ec770dbe5d60 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:12.265234 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-bcbff0e8-2e00-4656-a2ba-ec770dbe5d60 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:12.265938 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-bcbff0e8-2e00-4656-a2ba-ec770dbe5d60 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:12.266413 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-bcbff0e8-2e00-4656-a2ba-ec770dbe5d60 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:12.266835 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-bcbff0e8-2e00-4656-a2ba-ec770dbe5d60 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:12.409597 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-bcbff0e8-2e00-4656-a2ba-ec770dbe5d60 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:12.419123 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-bcbff0e8-2e00-4656-a2ba-ec770dbe5d60 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:12.420638 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-bcbff0e8-2e00-4656-a2ba-ec770dbe5d60 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:12.421828 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-bcbff0e8-2e00-4656-a2ba-ec770dbe5d60 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 200 len: 1720 microversion: 2.20 time: 0.169738 Aug 09 02:47:12.422419 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 430/889] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:47:12 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 1720 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:47:12.440027 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-dc03627c-c461-4ab6-8883-7310f5f4e852 tempest-VolumesSnapshotsTestJSON-1696348132 tempest-VolumesSnapshotsTestJSON-1696348132-project] Calling method '.version_select at 0x7fb0a039eaf0>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:12.489652 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-dc03627c-c461-4ab6-8883-7310f5f4e852 tempest-VolumesSnapshotsTestJSON-1696348132 tempest-VolumesSnapshotsTestJSON-1696348132-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/02e77b76-d359-4c33-8331-433d9e1e0e96" status: 200 len: 345 microversion: 2.1 time: 0.057546 Aug 09 02:47:12.490217 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 460/890] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Aug 9 02:47:12 2022] GET /compute/v2.1/os-volumes/02e77b76-d359-4c33-8331-433d9e1e0e96 => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:47:12.503057 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-c88f97dd-d3ae-495d-af56-8a3d9f523506 tempest-VolumesSnapshotsTestJSON-1696348132 tempest-VolumesSnapshotsTestJSON-1696348132-project] Action: 'create', calling method: .version_select at 0x7fb0a052caf0>, body: {"snapshot": {"volume_id": "02e77b76-d359-4c33-8331-433d9e1e0e96", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2043887605"}} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:47:12.671591 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-c88f97dd-d3ae-495d-af56-8a3d9f523506 tempest-VolumesSnapshotsTestJSON-1696348132 tempest-VolumesSnapshotsTestJSON-1696348132-project] 10.222.0.20 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.172529 Aug 09 02:47:12.672214 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 431/891] 10.222.0.20 () {60 vars in 1162 bytes} [Tue Aug 9 02:47:12 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:47:12.683844 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-f39b4d3a-baab-4abb-8bf0-65a1e48f757d tempest-VolumesSnapshotsTestJSON-1696348132 tempest-VolumesSnapshotsTestJSON-1696348132-project] Calling method '.version_select at 0x7fb0a0273f70>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:12.716134 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-f39b4d3a-baab-4abb-8bf0-65a1e48f757d tempest-VolumesSnapshotsTestJSON-1696348132 tempest-VolumesSnapshotsTestJSON-1696348132-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/ff467103-45b0-4d49-ac3c-664c8bf60a92" status: 200 len: 287 microversion: 2.1 time: 0.037226 Aug 09 02:47:12.722985 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 461/892] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Aug 9 02:47:12 2022] GET /compute/v2.1/os-snapshots/ff467103-45b0-4d49-ac3c-664c8bf60a92 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:47:12.729261 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-01ab7945-c8e9-461c-8c8e-ad2a1773d85b tempest-VolumesSnapshotsTestJSON-1696348132 tempest-VolumesSnapshotsTestJSON-1696348132-project] Calling method '.version_select at 0x7fb0a0317310>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:12.759827 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-01ab7945-c8e9-461c-8c8e-ad2a1773d85b tempest-VolumesSnapshotsTestJSON-1696348132 tempest-VolumesSnapshotsTestJSON-1696348132-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.034785 Aug 09 02:47:12.760625 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 432/893] 10.222.0.20 () {58 vars in 1140 bytes} [Tue Aug 9 02:47:12 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:47:12.771763 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-00eba4e8-3a2e-44b6-b344-9b8dd40da82c tempest-VolumesSnapshotsTestJSON-1696348132 tempest-VolumesSnapshotsTestJSON-1696348132-project] Calling method '.version_select at 0x7fb0a02ffe50>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:12.801964 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-00eba4e8-3a2e-44b6-b344-9b8dd40da82c tempest-VolumesSnapshotsTestJSON-1696348132 tempest-VolumesSnapshotsTestJSON-1696348132-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/ff467103-45b0-4d49-ac3c-664c8bf60a92" status: 200 len: 287 microversion: 2.1 time: 0.033893 Aug 09 02:47:12.802772 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 462/894] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Aug 9 02:47:12 2022] GET /compute/v2.1/os-snapshots/ff467103-45b0-4d49-ac3c-664c8bf60a92 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:47:13.444935 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-1827d3fe-c437-42f6-91eb-277cecb4a150 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:13.445572 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-1827d3fe-c437-42f6-91eb-277cecb4a150 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:47:13.453326 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1827d3fe-c437-42f6-91eb-277cecb4a150 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:13.453837 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1827d3fe-c437-42f6-91eb-277cecb4a150 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:13.454281 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1827d3fe-c437-42f6-91eb-277cecb4a150 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:13.455003 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1827d3fe-c437-42f6-91eb-277cecb4a150 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:13.455453 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1827d3fe-c437-42f6-91eb-277cecb4a150 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:13.455901 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1827d3fe-c437-42f6-91eb-277cecb4a150 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:13.584520 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-1827d3fe-c437-42f6-91eb-277cecb4a150 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:13.592966 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-1827d3fe-c437-42f6-91eb-277cecb4a150 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:13.594569 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-1827d3fe-c437-42f6-91eb-277cecb4a150 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:13.595753 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-1827d3fe-c437-42f6-91eb-277cecb4a150 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 200 len: 1720 microversion: 2.20 time: 0.154934 Aug 09 02:47:13.596315 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 433/895] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:47:13 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:47:13.815619 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-b4060cb2-c6fa-42ce-8d04-f624ccb09773 tempest-VolumesSnapshotsTestJSON-1696348132 tempest-VolumesSnapshotsTestJSON-1696348132-project] Calling method '.version_select at 0x7fb0a0228d30>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:13.851979 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-b4060cb2-c6fa-42ce-8d04-f624ccb09773 tempest-VolumesSnapshotsTestJSON-1696348132 tempest-VolumesSnapshotsTestJSON-1696348132-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/ff467103-45b0-4d49-ac3c-664c8bf60a92" status: 200 len: 287 microversion: 2.1 time: 0.040683 Aug 09 02:47:13.857513 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 463/896] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Aug 9 02:47:13 2022] GET /compute/v2.1/os-snapshots/ff467103-45b0-4d49-ac3c-664c8bf60a92 => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:47:14.619223 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-4f59dd77-2ad8-47d1-914a-fd54154d8cff tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:14.619899 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-4f59dd77-2ad8-47d1-914a-fd54154d8cff tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:47:14.627119 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4f59dd77-2ad8-47d1-914a-fd54154d8cff tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:14.627605 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4f59dd77-2ad8-47d1-914a-fd54154d8cff tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:14.628040 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4f59dd77-2ad8-47d1-914a-fd54154d8cff tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:14.628738 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4f59dd77-2ad8-47d1-914a-fd54154d8cff tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:14.629271 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4f59dd77-2ad8-47d1-914a-fd54154d8cff tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:14.629700 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-4f59dd77-2ad8-47d1-914a-fd54154d8cff tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:14.762592 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-4f59dd77-2ad8-47d1-914a-fd54154d8cff tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:14.770755 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-4f59dd77-2ad8-47d1-914a-fd54154d8cff tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:14.772298 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-4f59dd77-2ad8-47d1-914a-fd54154d8cff tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:14.773484 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-4f59dd77-2ad8-47d1-914a-fd54154d8cff tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 200 len: 1720 microversion: 2.20 time: 0.158291 Aug 09 02:47:14.774057 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 434/897] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:47:14 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:47:14.869886 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-6a4131f8-a0f5-4ff6-b3fa-d6edfc6c6250 tempest-VolumesSnapshotsTestJSON-1696348132 tempest-VolumesSnapshotsTestJSON-1696348132-project] Calling method '.version_select at 0x7fb0a03c5700>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:14.906583 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-6a4131f8-a0f5-4ff6-b3fa-d6edfc6c6250 tempest-VolumesSnapshotsTestJSON-1696348132 tempest-VolumesSnapshotsTestJSON-1696348132-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/ff467103-45b0-4d49-ac3c-664c8bf60a92" status: 200 len: 287 microversion: 2.1 time: 0.044546 Aug 09 02:47:14.907164 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 464/898] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Aug 9 02:47:14 2022] GET /compute/v2.1/os-snapshots/ff467103-45b0-4d49-ac3c-664c8bf60a92 => generated 287 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:47:15.800782 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-a961fbca-fd5b-4a6d-906b-50fb20e1054a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:15.801639 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-a961fbca-fd5b-4a6d-906b-50fb20e1054a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:47:15.812478 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a961fbca-fd5b-4a6d-906b-50fb20e1054a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:15.813298 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a961fbca-fd5b-4a6d-906b-50fb20e1054a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:15.814011 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a961fbca-fd5b-4a6d-906b-50fb20e1054a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:15.815197 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a961fbca-fd5b-4a6d-906b-50fb20e1054a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:15.815935 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a961fbca-fd5b-4a6d-906b-50fb20e1054a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:15.816648 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a961fbca-fd5b-4a6d-906b-50fb20e1054a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:15.835742 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:47:15.918994 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-bcc9b4c4-b913-4228-9331-8d725a659548 tempest-VolumesSnapshotsTestJSON-1696348132 tempest-VolumesSnapshotsTestJSON-1696348132-project] Calling method '.version_select at 0x7fb0a02289d0>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:15.950984 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-bcc9b4c4-b913-4228-9331-8d725a659548 tempest-VolumesSnapshotsTestJSON-1696348132 tempest-VolumesSnapshotsTestJSON-1696348132-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/ff467103-45b0-4d49-ac3c-664c8bf60a92" status: 200 len: 288 microversion: 2.1 time: 0.035717 Aug 09 02:47:15.951862 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 465/899] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Aug 9 02:47:15 2022] GET /compute/v2.1/os-snapshots/ff467103-45b0-4d49-ac3c-664c8bf60a92 => generated 288 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:47:15.962794 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-bf82d6ec-a06c-408c-b98f-abdd9ff89936 tempest-VolumesSnapshotsTestJSON-1696348132 tempest-VolumesSnapshotsTestJSON-1696348132-project] Calling method '.version_select at 0x7fb0a02ff820>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:15.976455 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-a961fbca-fd5b-4a6d-906b-50fb20e1054a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:15.986310 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-a961fbca-fd5b-4a6d-906b-50fb20e1054a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:15.988470 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-a961fbca-fd5b-4a6d-906b-50fb20e1054a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:15.989830 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-a961fbca-fd5b-4a6d-906b-50fb20e1054a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 200 len: 1720 microversion: 2.20 time: 0.195959 Aug 09 02:47:15.990698 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 435/900] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:47:15 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 1720 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:47:16.022565 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-bf82d6ec-a06c-408c-b98f-abdd9ff89936 tempest-VolumesSnapshotsTestJSON-1696348132 tempest-VolumesSnapshotsTestJSON-1696348132-project] 10.222.0.20 "DELETE /compute/v2.1/os-snapshots/ff467103-45b0-4d49-ac3c-664c8bf60a92" status: 202 len: 0 microversion: 2.1 time: 0.063655 Aug 09 02:47:16.023239 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 466/901] 10.222.0.20 () {58 vars in 1254 bytes} [Tue Aug 9 02:47:15 2022] DELETE /compute/v2.1/os-snapshots/ff467103-45b0-4d49-ac3c-664c8bf60a92 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 02:47:16.031480 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-1398352b-75e6-4feb-af28-36c663c624ab tempest-VolumesSnapshotsTestJSON-1696348132 tempest-VolumesSnapshotsTestJSON-1696348132-project] Calling method '.version_select at 0x7fb0a03ba8b0>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:16.060464 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-1398352b-75e6-4feb-af28-36c663c624ab tempest-VolumesSnapshotsTestJSON-1696348132 tempest-VolumesSnapshotsTestJSON-1696348132-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/ff467103-45b0-4d49-ac3c-664c8bf60a92" status: 200 len: 287 microversion: 2.1 time: 0.032856 Aug 09 02:47:16.061333 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 436/902] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Aug 9 02:47:16 2022] GET /compute/v2.1/os-snapshots/ff467103-45b0-4d49-ac3c-664c8bf60a92 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:47:17.017529 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-386bae89-cdde-4ca2-b5de-53f9ed80a6f3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:17.018683 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-386bae89-cdde-4ca2-b5de-53f9ed80a6f3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:47:17.029896 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-386bae89-cdde-4ca2-b5de-53f9ed80a6f3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:17.030820 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-386bae89-cdde-4ca2-b5de-53f9ed80a6f3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:17.031252 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-386bae89-cdde-4ca2-b5de-53f9ed80a6f3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:17.031939 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-386bae89-cdde-4ca2-b5de-53f9ed80a6f3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:17.032389 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-386bae89-cdde-4ca2-b5de-53f9ed80a6f3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:17.032817 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-386bae89-cdde-4ca2-b5de-53f9ed80a6f3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:17.073413 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-2d9015c9-470d-43cd-a71f-77f6f1c682c7 tempest-VolumesSnapshotsTestJSON-1696348132 tempest-VolumesSnapshotsTestJSON-1696348132-project] Calling method '.version_select at 0x7fb0a03174c0>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:17.099742 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.wsgi [None req-2d9015c9-470d-43cd-a71f-77f6f1c682c7 tempest-VolumesSnapshotsTestJSON-1696348132 tempest-VolumesSnapshotsTestJSON-1696348132-project] HTTP exception thrown: Snapshot ff467103-45b0-4d49-ac3c-664c8bf60a92 could not be found. Aug 09 02:47:17.103000 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-2d9015c9-470d-43cd-a71f-77f6f1c682c7 tempest-VolumesSnapshotsTestJSON-1696348132 tempest-VolumesSnapshotsTestJSON-1696348132-project] Request method failure captured: Aug 09 02:47:17.103000 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: request: GET /compute/v2.1/os-snapshots/ff467103-45b0-4d49-ac3c-664c8bf60a92 HTTP/1.1 Aug 09 02:47:17.103000 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Accept: application/json Aug 09 02:47:17.103000 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Accept-Encoding: identity Aug 09 02:47:17.103000 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Connection: close Aug 09 02:47:17.103000 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Content-Length: 0 Aug 09 02:47:17.103000 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Content-Type: application/json Aug 09 02:47:17.103000 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Host: 10.222.0.20 Aug 09 02:47:17.103000 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Openstack-System-Scope: None Aug 09 02:47:17.103000 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: User-Agent: python-urllib3/1.26.11 Aug 09 02:47:17.103000 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Auth-Token: gAAAAABi8cquPzq8LLsOxmJvIxpuYriDCVZmki1E7sgSumEuA38a4iqG1OcuETonUC1Kg0Log3hIfR8Zw9mMM0afHfqIF6HpIvryuYKTVHdZzPNjk3r2Jlcu12oEZJjuelDvYoj8cvrWXhEO2YVEu3InCJ14XH3gjnuReByz4YWiBfcx8Bnyry4 Aug 09 02:47:17.103000 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Domain-Id: None Aug 09 02:47:17.103000 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Domain-Name: None Aug 09 02:47:17.103000 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Identity-Status: Confirmed Aug 09 02:47:17.103000 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Is-Admin-Project: True Aug 09 02:47:17.103000 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Domain-Id: default Aug 09 02:47:17.103000 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Domain-Name: Default Aug 09 02:47:17.103000 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Id: 3dd9b0c6a3054114b6f7b5db74101f15 Aug 09 02:47:17.103000 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1696348132 Aug 09 02:47:17.103000 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Role: reader,member Aug 09 02:47:17.103000 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Roles: reader,member Aug 09 02:47:17.104589 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3dd9b0c6a3054114b6f7b5db74101f15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3dd9b0c6a3054114b6f7b5db74101f15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3dd9b0c6a3054114b6f7b5db74101f15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3dd9b0c6a3054114b6f7b5db74101f15"}]}] Aug 09 02:47:17.104589 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1696348132 Aug 09 02:47:17.104589 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant-Id: 3dd9b0c6a3054114b6f7b5db74101f15 Aug 09 02:47:17.104589 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1696348132 Aug 09 02:47:17.104589 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User: tempest-VolumesSnapshotsTestJSON-1696348132-project Aug 09 02:47:17.104589 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Domain-Id: default Aug 09 02:47:17.104589 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Domain-Name: Default Aug 09 02:47:17.104589 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Id: 57b1873a17c0452b96043e364effb50c Aug 09 02:47:17.104589 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1696348132-project Aug 09 02:47:17.104589 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: method: Aug 09 02:47:17.104589 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: exception: Snapshot ff467103-45b0-4d49-ac3c-664c8bf60a92 could not be found. Aug 09 02:47:17.104589 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: action_args: {'id': 'ff467103-45b0-4d49-ac3c-664c8bf60a92'} Aug 09 02:47:17.104589 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 02:47:17.105517 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:17.105517 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 09 02:47:17.105517 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 09 02:47:17.105517 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 09 02:47:17.105517 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 09 02:47:17.105517 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 09 02:47:17.105517 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 09 02:47:17.105517 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 02:47:17.105517 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 02:47:17.105517 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 02:47:17.105517 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 02:47:17.105517 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 02:47:17.105517 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 02:47:17.105517 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 02:47:17.105517 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 02:47:17.105517 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot ff467103-45b0-4d49-ac3c-664c8bf60a92 could not be found. (HTTP 404) (Request-ID: req-4e9c19ea-e8bd-4819-a6ce-115cc2e790ba) Aug 09 02:47:17.105517 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:47:17.105517 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:47:17.106879 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:47:17.106879 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:17.106879 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 09 02:47:17.106879 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 09 02:47:17.106879 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 02:47:17.106879 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 02:47:17.106879 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 09 02:47:17.106879 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 09 02:47:17.106879 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 02:47:17.106879 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 02:47:17.106879 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 09 02:47:17.106879 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 09 02:47:17.106879 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 09 02:47:17.106879 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 09 02:47:17.106879 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 09 02:47:17.106879 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 09 02:47:17.106879 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 02:47:17.106879 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 02:47:17.106879 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 02:47:17.108874 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 02:47:17.108874 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 02:47:17.108874 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 02:47:17.108874 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 02:47:17.108874 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 02:47:17.108874 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot ff467103-45b0-4d49-ac3c-664c8bf60a92 could not be found. Aug 09 02:47:17.108874 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:47:17.108874 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:47:17.108874 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:47:17.108874 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:17.108874 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:47:17.108874 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:47:17.108874 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 02:47:17.108874 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 02:47:17.108874 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 02:47:17.108874 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 02:47:17.108874 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 02:47:17.108874 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 02:47:17.108874 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 09 02:47:17.108874 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 02:47:17.111543 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot ff467103-45b0-4d49-ac3c-664c8bf60a92 could not be found. Aug 09 02:47:17.111543 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:47:17.111543 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:47:17.111543 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:47:17.111543 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:17.111543 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:47:17.111543 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:47:17.111543 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 02:47:17.111543 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 02:47:17.111543 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot ff467103-45b0-4d49-ac3c-664c8bf60a92 could not be found. Aug 09 02:47:17.111543 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:47:17.111543 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-2d9015c9-470d-43cd-a71f-77f6f1c682c7 tempest-VolumesSnapshotsTestJSON-1696348132 tempest-VolumesSnapshotsTestJSON-1696348132-project] Returning 404 to user: Snapshot ff467103-45b0-4d49-ac3c-664c8bf60a92 could not be found. {{(pid=124425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 02:47:17.111543 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-2d9015c9-470d-43cd-a71f-77f6f1c682c7 tempest-VolumesSnapshotsTestJSON-1696348132 tempest-VolumesSnapshotsTestJSON-1696348132-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/ff467103-45b0-4d49-ac3c-664c8bf60a92" status: 404 len: 111 microversion: 2.1 time: 0.035497 Aug 09 02:47:17.114082 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 437/903] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Aug 9 02:47:17 2022] GET /compute/v2.1/os-snapshots/ff467103-45b0-4d49-ac3c-664c8bf60a92 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 02:47:17.114386 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-7ffde103-aa74-4cfd-b96d-5505fccac91b tempest-VolumesSnapshotsTestJSON-1696348132 tempest-VolumesSnapshotsTestJSON-1696348132-project] Calling method '.version_select at 0x7fb0a03173a0>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:17.164197 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-386bae89-cdde-4ca2-b5de-53f9ed80a6f3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:17.172659 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-386bae89-cdde-4ca2-b5de-53f9ed80a6f3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:17.174140 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-386bae89-cdde-4ca2-b5de-53f9ed80a6f3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:17.175568 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-386bae89-cdde-4ca2-b5de-53f9ed80a6f3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 200 len: 1741 microversion: 2.20 time: 0.165382 Aug 09 02:47:17.176621 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 467/904] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:47:17 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 1741 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:47:17.179226 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-7ffde103-aa74-4cfd-b96d-5505fccac91b tempest-VolumesSnapshotsTestJSON-1696348132 tempest-VolumesSnapshotsTestJSON-1696348132-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/02e77b76-d359-4c33-8331-433d9e1e0e96" status: 202 len: 0 microversion: 2.1 time: 0.069791 Aug 09 02:47:17.179804 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 438/905] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Aug 9 02:47:17 2022] DELETE /compute/v2.1/os-volumes/02e77b76-d359-4c33-8331-433d9e1e0e96 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 02:47:17.187778 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-d067579e-f3b7-4d72-ad19-f9ce351f1a06 tempest-VolumesSnapshotsTestJSON-1696348132 tempest-VolumesSnapshotsTestJSON-1696348132-project] Calling method '.version_select at 0x7fb0a02d5af0>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:17.245724 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-d067579e-f3b7-4d72-ad19-f9ce351f1a06 tempest-VolumesSnapshotsTestJSON-1696348132 tempest-VolumesSnapshotsTestJSON-1696348132-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/02e77b76-d359-4c33-8331-433d9e1e0e96" status: 200 len: 344 microversion: 2.1 time: 0.061412 Aug 09 02:47:17.246597 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 468/906] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Aug 9 02:47:17 2022] GET /compute/v2.1/os-volumes/02e77b76-d359-4c33-8331-433d9e1e0e96 => generated 344 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 02:47:18.204009 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-26bf81b2-7641-49da-8bdd-5e8e84167485 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:18.204699 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-26bf81b2-7641-49da-8bdd-5e8e84167485 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:47:18.211783 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-26bf81b2-7641-49da-8bdd-5e8e84167485 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:18.212320 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-26bf81b2-7641-49da-8bdd-5e8e84167485 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:18.212804 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-26bf81b2-7641-49da-8bdd-5e8e84167485 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:18.213563 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-26bf81b2-7641-49da-8bdd-5e8e84167485 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:18.214061 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-26bf81b2-7641-49da-8bdd-5e8e84167485 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:18.214570 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-26bf81b2-7641-49da-8bdd-5e8e84167485 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:18.261255 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-ef62e2e0-e61f-485a-8f2e-802490926fe8 tempest-VolumesSnapshotsTestJSON-1696348132 tempest-VolumesSnapshotsTestJSON-1696348132-project] Calling method '.version_select at 0x7fb0a0228af0>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:18.289810 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.wsgi [None req-ef62e2e0-e61f-485a-8f2e-802490926fe8 tempest-VolumesSnapshotsTestJSON-1696348132 tempest-VolumesSnapshotsTestJSON-1696348132-project] HTTP exception thrown: Volume 02e77b76-d359-4c33-8331-433d9e1e0e96 could not be found. Aug 09 02:47:18.291787 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-ef62e2e0-e61f-485a-8f2e-802490926fe8 tempest-VolumesSnapshotsTestJSON-1696348132 tempest-VolumesSnapshotsTestJSON-1696348132-project] Request method failure captured: Aug 09 02:47:18.291787 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: request: GET /compute/v2.1/os-volumes/02e77b76-d359-4c33-8331-433d9e1e0e96 HTTP/1.1 Aug 09 02:47:18.291787 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Accept: application/json Aug 09 02:47:18.291787 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Accept-Encoding: identity Aug 09 02:47:18.291787 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Connection: close Aug 09 02:47:18.291787 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Content-Length: 0 Aug 09 02:47:18.291787 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Content-Type: application/json Aug 09 02:47:18.291787 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Host: 10.222.0.20 Aug 09 02:47:18.291787 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Openstack-System-Scope: None Aug 09 02:47:18.291787 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: User-Agent: python-urllib3/1.26.11 Aug 09 02:47:18.291787 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Auth-Token: gAAAAABi8cquPzq8LLsOxmJvIxpuYriDCVZmki1E7sgSumEuA38a4iqG1OcuETonUC1Kg0Log3hIfR8Zw9mMM0afHfqIF6HpIvryuYKTVHdZzPNjk3r2Jlcu12oEZJjuelDvYoj8cvrWXhEO2YVEu3InCJ14XH3gjnuReByz4YWiBfcx8Bnyry4 Aug 09 02:47:18.291787 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Domain-Id: None Aug 09 02:47:18.291787 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Domain-Name: None Aug 09 02:47:18.291787 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Identity-Status: Confirmed Aug 09 02:47:18.291787 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Is-Admin-Project: True Aug 09 02:47:18.291787 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Domain-Id: default Aug 09 02:47:18.291787 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Domain-Name: Default Aug 09 02:47:18.291787 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Id: 3dd9b0c6a3054114b6f7b5db74101f15 Aug 09 02:47:18.291787 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1696348132 Aug 09 02:47:18.291787 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Role: reader,member Aug 09 02:47:18.291787 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Roles: reader,member Aug 09 02:47:18.293382 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3dd9b0c6a3054114b6f7b5db74101f15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3dd9b0c6a3054114b6f7b5db74101f15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3dd9b0c6a3054114b6f7b5db74101f15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3dd9b0c6a3054114b6f7b5db74101f15"}]}] Aug 09 02:47:18.293382 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1696348132 Aug 09 02:47:18.293382 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant-Id: 3dd9b0c6a3054114b6f7b5db74101f15 Aug 09 02:47:18.293382 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1696348132 Aug 09 02:47:18.293382 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User: tempest-VolumesSnapshotsTestJSON-1696348132-project Aug 09 02:47:18.293382 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Domain-Id: default Aug 09 02:47:18.293382 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Domain-Name: Default Aug 09 02:47:18.293382 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Id: 57b1873a17c0452b96043e364effb50c Aug 09 02:47:18.293382 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1696348132-project Aug 09 02:47:18.293382 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: method: Aug 09 02:47:18.293382 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: exception: Volume 02e77b76-d359-4c33-8331-433d9e1e0e96 could not be found. Aug 09 02:47:18.293382 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: action_args: {'id': '02e77b76-d359-4c33-8331-433d9e1e0e96'} Aug 09 02:47:18.293382 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 02:47:18.294322 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:18.294322 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 02:47:18.294322 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 02:47:18.294322 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 02:47:18.294322 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 02:47:18.294322 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 02:47:18.294322 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 02:47:18.294322 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 02:47:18.294322 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 02:47:18.294322 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 02:47:18.294322 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 02:47:18.294322 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 02:47:18.294322 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 02:47:18.294322 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 02:47:18.294322 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 02:47:18.294322 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 02e77b76-d359-4c33-8331-433d9e1e0e96 could not be found. (HTTP 404) (Request-ID: req-5c48782a-05e8-451b-a8e4-d56f61c8e27b) Aug 09 02:47:18.294322 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:18.294322 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:47:18.294322 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:18.295582 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:18.295582 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 09 02:47:18.295582 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 09 02:47:18.295582 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 02:47:18.295582 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 02:47:18.295582 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 02:47:18.295582 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 02:47:18.295582 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 02:47:18.295582 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 02:47:18.295582 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 02:47:18.295582 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 02:47:18.295582 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 02:47:18.295582 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 02:47:18.295582 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 02:47:18.295582 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 02:47:18.295582 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 02:47:18.295582 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 02:47:18.295582 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 02:47:18.295582 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 02:47:18.296834 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 02:47:18.296834 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 02:47:18.296834 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 02:47:18.296834 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 02:47:18.296834 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 02e77b76-d359-4c33-8331-433d9e1e0e96 could not be found. Aug 09 02:47:18.296834 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:18.296834 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:47:18.296834 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:18.296834 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:18.296834 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:47:18.296834 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:47:18.296834 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 02:47:18.296834 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 02:47:18.296834 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 02:47:18.296834 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 02:47:18.296834 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 02:47:18.296834 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 02:47:18.296834 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 09 02:47:18.296834 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 02:47:18.298885 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 02e77b76-d359-4c33-8331-433d9e1e0e96 could not be found. Aug 09 02:47:18.298885 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:18.298885 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:47:18.298885 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:18.298885 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:18.298885 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:47:18.298885 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:47:18.298885 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 02:47:18.298885 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 02:47:18.298885 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 02e77b76-d359-4c33-8331-433d9e1e0e96 could not be found. Aug 09 02:47:18.298885 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:18.298885 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-ef62e2e0-e61f-485a-8f2e-802490926fe8 tempest-VolumesSnapshotsTestJSON-1696348132 tempest-VolumesSnapshotsTestJSON-1696348132-project] Returning 404 to user: Volume 02e77b76-d359-4c33-8331-433d9e1e0e96 could not be found. {{(pid=124427) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 02:47:18.298885 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-ef62e2e0-e61f-485a-8f2e-802490926fe8 tempest-VolumesSnapshotsTestJSON-1696348132 tempest-VolumesSnapshotsTestJSON-1696348132-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/02e77b76-d359-4c33-8331-433d9e1e0e96" status: 404 len: 109 microversion: 2.1 time: 0.036705 Aug 09 02:47:18.298885 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 469/907] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Aug 9 02:47:18 2022] GET /compute/v2.1/os-volumes/02e77b76-d359-4c33-8331-433d9e1e0e96 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 02:47:18.306743 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-d12c1ad7-c2a5-4bcb-95db-3b17821490ff tempest-VolumesSnapshotsTestJSON-1696348132 tempest-VolumesSnapshotsTestJSON-1696348132-project] Calling method '.version_select at 0x7fb0a0228d30>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:18.335490 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.wsgi [None req-d12c1ad7-c2a5-4bcb-95db-3b17821490ff tempest-VolumesSnapshotsTestJSON-1696348132 tempest-VolumesSnapshotsTestJSON-1696348132-project] HTTP exception thrown: Volume 02e77b76-d359-4c33-8331-433d9e1e0e96 could not be found. Aug 09 02:47:18.337464 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-d12c1ad7-c2a5-4bcb-95db-3b17821490ff tempest-VolumesSnapshotsTestJSON-1696348132 tempest-VolumesSnapshotsTestJSON-1696348132-project] Request method failure captured: Aug 09 02:47:18.337464 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: request: DELETE /compute/v2.1/os-volumes/02e77b76-d359-4c33-8331-433d9e1e0e96 HTTP/1.1 Aug 09 02:47:18.337464 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Accept: application/json Aug 09 02:47:18.337464 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Accept-Encoding: identity Aug 09 02:47:18.337464 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Connection: close Aug 09 02:47:18.337464 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Content-Length: 0 Aug 09 02:47:18.337464 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Content-Type: application/json Aug 09 02:47:18.337464 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Host: 10.222.0.20 Aug 09 02:47:18.337464 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Openstack-System-Scope: None Aug 09 02:47:18.337464 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: User-Agent: python-urllib3/1.26.11 Aug 09 02:47:18.337464 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Auth-Token: gAAAAABi8cquPzq8LLsOxmJvIxpuYriDCVZmki1E7sgSumEuA38a4iqG1OcuETonUC1Kg0Log3hIfR8Zw9mMM0afHfqIF6HpIvryuYKTVHdZzPNjk3r2Jlcu12oEZJjuelDvYoj8cvrWXhEO2YVEu3InCJ14XH3gjnuReByz4YWiBfcx8Bnyry4 Aug 09 02:47:18.337464 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Domain-Id: None Aug 09 02:47:18.337464 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Domain-Name: None Aug 09 02:47:18.337464 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Identity-Status: Confirmed Aug 09 02:47:18.337464 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Is-Admin-Project: True Aug 09 02:47:18.337464 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Domain-Id: default Aug 09 02:47:18.337464 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Domain-Name: Default Aug 09 02:47:18.337464 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Id: 3dd9b0c6a3054114b6f7b5db74101f15 Aug 09 02:47:18.337464 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1696348132 Aug 09 02:47:18.337464 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Role: reader,member Aug 09 02:47:18.337464 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Roles: reader,member Aug 09 02:47:18.339058 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3dd9b0c6a3054114b6f7b5db74101f15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3dd9b0c6a3054114b6f7b5db74101f15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3dd9b0c6a3054114b6f7b5db74101f15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3dd9b0c6a3054114b6f7b5db74101f15"}]}] Aug 09 02:47:18.339058 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1696348132 Aug 09 02:47:18.339058 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant-Id: 3dd9b0c6a3054114b6f7b5db74101f15 Aug 09 02:47:18.339058 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1696348132 Aug 09 02:47:18.339058 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User: tempest-VolumesSnapshotsTestJSON-1696348132-project Aug 09 02:47:18.339058 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Domain-Id: default Aug 09 02:47:18.339058 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Domain-Name: Default Aug 09 02:47:18.339058 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Id: 57b1873a17c0452b96043e364effb50c Aug 09 02:47:18.339058 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1696348132-project Aug 09 02:47:18.339058 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: method: Aug 09 02:47:18.339058 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: exception: Volume 02e77b76-d359-4c33-8331-433d9e1e0e96 could not be found. Aug 09 02:47:18.339058 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: action_args: {'id': '02e77b76-d359-4c33-8331-433d9e1e0e96'} Aug 09 02:47:18.339058 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 02:47:18.343070 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:18.343070 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 02:47:18.343070 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 02:47:18.343070 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 02:47:18.343070 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 02:47:18.343070 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 02:47:18.343070 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 02:47:18.343070 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 02:47:18.343070 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 02:47:18.343070 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 02:47:18.343070 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 02:47:18.343070 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 02:47:18.343070 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 02:47:18.343070 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 02:47:18.343070 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 02:47:18.343070 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 02e77b76-d359-4c33-8331-433d9e1e0e96 could not be found. (HTTP 404) (Request-ID: req-aae49721-115b-496f-b03a-a08b3e08a00b) Aug 09 02:47:18.343070 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:18.343070 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:47:18.343070 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:18.344571 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:18.344571 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 09 02:47:18.344571 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 09 02:47:18.344571 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 02:47:18.344571 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 02:47:18.344571 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 02:47:18.344571 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 02:47:18.344571 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 02:47:18.344571 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 02:47:18.344571 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 02:47:18.344571 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 02:47:18.344571 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 02:47:18.344571 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 02:47:18.344571 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 02:47:18.344571 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 02:47:18.344571 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 02:47:18.344571 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 02:47:18.344571 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 02:47:18.344571 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 02:47:18.346051 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 02:47:18.346051 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 02:47:18.346051 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 02:47:18.346051 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 02:47:18.346051 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 02e77b76-d359-4c33-8331-433d9e1e0e96 could not be found. Aug 09 02:47:18.346051 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:18.346051 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:47:18.346051 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:18.346051 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:18.346051 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:47:18.346051 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:47:18.346051 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 02:47:18.346051 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 02:47:18.346051 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 02:47:18.346051 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 02:47:18.346051 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 02:47:18.346051 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 02:47:18.346051 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 09 02:47:18.346051 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 02:47:18.347462 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 02e77b76-d359-4c33-8331-433d9e1e0e96 could not be found. Aug 09 02:47:18.347462 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:18.347462 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:47:18.347462 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:18.347462 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:18.347462 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:47:18.347462 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:47:18.347462 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 02:47:18.347462 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 02:47:18.347462 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 02e77b76-d359-4c33-8331-433d9e1e0e96 could not be found. Aug 09 02:47:18.347462 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:18.347462 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-d12c1ad7-c2a5-4bcb-95db-3b17821490ff tempest-VolumesSnapshotsTestJSON-1696348132 tempest-VolumesSnapshotsTestJSON-1696348132-project] Returning 404 to user: Volume 02e77b76-d359-4c33-8331-433d9e1e0e96 could not be found. {{(pid=124427) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 02:47:18.347462 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-d12c1ad7-c2a5-4bcb-95db-3b17821490ff tempest-VolumesSnapshotsTestJSON-1696348132 tempest-VolumesSnapshotsTestJSON-1696348132-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/02e77b76-d359-4c33-8331-433d9e1e0e96" status: 404 len: 109 microversion: 2.1 time: 0.036875 Aug 09 02:47:18.347462 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 470/908] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Aug 9 02:47:18 2022] DELETE /compute/v2.1/os-volumes/02e77b76-d359-4c33-8331-433d9e1e0e96 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 02:47:18.350505 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-26bf81b2-7641-49da-8bdd-5e8e84167485 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:18.354274 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-2e0adf32-cd99-45ff-a2ce-67e62619e997 tempest-VolumesSnapshotsTestJSON-1696348132 tempest-VolumesSnapshotsTestJSON-1696348132-project] Calling method '.version_select at 0x7fb0a02ffc10>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:18.358777 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-26bf81b2-7641-49da-8bdd-5e8e84167485 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:18.360374 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-26bf81b2-7641-49da-8bdd-5e8e84167485 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:18.361550 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-26bf81b2-7641-49da-8bdd-5e8e84167485 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 200 len: 1741 microversion: 2.20 time: 0.164543 Aug 09 02:47:18.362134 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 439/909] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:47:18 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 1741 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:47:18.382549 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.wsgi [None req-2e0adf32-cd99-45ff-a2ce-67e62619e997 tempest-VolumesSnapshotsTestJSON-1696348132 tempest-VolumesSnapshotsTestJSON-1696348132-project] HTTP exception thrown: Volume 02e77b76-d359-4c33-8331-433d9e1e0e96 could not be found. Aug 09 02:47:18.385002 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-2e0adf32-cd99-45ff-a2ce-67e62619e997 tempest-VolumesSnapshotsTestJSON-1696348132 tempest-VolumesSnapshotsTestJSON-1696348132-project] Request method failure captured: Aug 09 02:47:18.385002 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: request: GET /compute/v2.1/os-volumes/02e77b76-d359-4c33-8331-433d9e1e0e96 HTTP/1.1 Aug 09 02:47:18.385002 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Accept: application/json Aug 09 02:47:18.385002 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Accept-Encoding: identity Aug 09 02:47:18.385002 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Connection: close Aug 09 02:47:18.385002 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Content-Length: 0 Aug 09 02:47:18.385002 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Content-Type: application/json Aug 09 02:47:18.385002 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Host: 10.222.0.20 Aug 09 02:47:18.385002 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Openstack-System-Scope: None Aug 09 02:47:18.385002 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: User-Agent: python-urllib3/1.26.11 Aug 09 02:47:18.385002 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Auth-Token: gAAAAABi8cquPzq8LLsOxmJvIxpuYriDCVZmki1E7sgSumEuA38a4iqG1OcuETonUC1Kg0Log3hIfR8Zw9mMM0afHfqIF6HpIvryuYKTVHdZzPNjk3r2Jlcu12oEZJjuelDvYoj8cvrWXhEO2YVEu3InCJ14XH3gjnuReByz4YWiBfcx8Bnyry4 Aug 09 02:47:18.385002 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Domain-Id: None Aug 09 02:47:18.385002 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Domain-Name: None Aug 09 02:47:18.385002 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Identity-Status: Confirmed Aug 09 02:47:18.385002 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Is-Admin-Project: True Aug 09 02:47:18.385002 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Domain-Id: default Aug 09 02:47:18.385002 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Domain-Name: Default Aug 09 02:47:18.385002 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Id: 3dd9b0c6a3054114b6f7b5db74101f15 Aug 09 02:47:18.385002 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1696348132 Aug 09 02:47:18.385002 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Role: reader,member Aug 09 02:47:18.385002 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Roles: reader,member Aug 09 02:47:18.386645 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3dd9b0c6a3054114b6f7b5db74101f15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3dd9b0c6a3054114b6f7b5db74101f15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3dd9b0c6a3054114b6f7b5db74101f15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3dd9b0c6a3054114b6f7b5db74101f15"}]}] Aug 09 02:47:18.386645 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1696348132 Aug 09 02:47:18.386645 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant-Id: 3dd9b0c6a3054114b6f7b5db74101f15 Aug 09 02:47:18.386645 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1696348132 Aug 09 02:47:18.386645 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User: tempest-VolumesSnapshotsTestJSON-1696348132-project Aug 09 02:47:18.386645 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Domain-Id: default Aug 09 02:47:18.386645 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Domain-Name: Default Aug 09 02:47:18.386645 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Id: 57b1873a17c0452b96043e364effb50c Aug 09 02:47:18.386645 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1696348132-project Aug 09 02:47:18.386645 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: method: Aug 09 02:47:18.386645 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: exception: Volume 02e77b76-d359-4c33-8331-433d9e1e0e96 could not be found. Aug 09 02:47:18.386645 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: action_args: {'id': '02e77b76-d359-4c33-8331-433d9e1e0e96'} Aug 09 02:47:18.386645 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 02:47:18.387513 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:18.387513 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 02:47:18.387513 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 02:47:18.387513 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 02:47:18.387513 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 02:47:18.387513 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 02:47:18.387513 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 02:47:18.387513 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 02:47:18.387513 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 02:47:18.387513 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 02:47:18.387513 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 02:47:18.387513 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 02:47:18.387513 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 02:47:18.387513 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 02:47:18.387513 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 02:47:18.387513 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 02e77b76-d359-4c33-8331-433d9e1e0e96 could not be found. (HTTP 404) (Request-ID: req-e1beeb7f-8a2d-4662-8863-1fd0d1036802) Aug 09 02:47:18.387513 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:18.387513 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:47:18.387513 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:18.388677 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:18.388677 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 09 02:47:18.388677 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 09 02:47:18.388677 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 02:47:18.388677 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 02:47:18.388677 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 02:47:18.388677 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 02:47:18.388677 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 02:47:18.388677 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 02:47:18.388677 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 02:47:18.388677 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 02:47:18.388677 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 02:47:18.388677 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 02:47:18.388677 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 02:47:18.388677 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 02:47:18.388677 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 02:47:18.388677 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 02:47:18.388677 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 02:47:18.388677 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 02:47:18.389825 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 02:47:18.389825 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 02:47:18.389825 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 02:47:18.389825 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 02:47:18.389825 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 02e77b76-d359-4c33-8331-433d9e1e0e96 could not be found. Aug 09 02:47:18.389825 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:18.389825 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:47:18.389825 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:18.389825 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:18.389825 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:47:18.389825 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:47:18.389825 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 02:47:18.389825 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 02:47:18.389825 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 02:47:18.389825 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 02:47:18.389825 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 02:47:18.389825 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 02:47:18.389825 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 09 02:47:18.389825 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 02:47:18.391142 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 02e77b76-d359-4c33-8331-433d9e1e0e96 could not be found. Aug 09 02:47:18.391142 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:18.391142 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:47:18.391142 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:18.391142 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:18.391142 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:47:18.391142 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:47:18.391142 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 02:47:18.391142 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 02:47:18.391142 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 02e77b76-d359-4c33-8331-433d9e1e0e96 could not be found. Aug 09 02:47:18.391142 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:18.391142 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-2e0adf32-cd99-45ff-a2ce-67e62619e997 tempest-VolumesSnapshotsTestJSON-1696348132 tempest-VolumesSnapshotsTestJSON-1696348132-project] Returning 404 to user: Volume 02e77b76-d359-4c33-8331-433d9e1e0e96 could not be found. {{(pid=124427) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 02:47:18.391142 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-2e0adf32-cd99-45ff-a2ce-67e62619e997 tempest-VolumesSnapshotsTestJSON-1696348132 tempest-VolumesSnapshotsTestJSON-1696348132-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/02e77b76-d359-4c33-8331-433d9e1e0e96" status: 404 len: 109 microversion: 2.1 time: 0.042460 Aug 09 02:47:18.391142 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 471/910] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Aug 9 02:47:18 2022] GET /compute/v2.1/os-volumes/02e77b76-d359-4c33-8331-433d9e1e0e96 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 02:47:19.383927 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-bcc39173-4e60-42ab-8b5b-5465268f68bb tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:19.384540 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-bcc39173-4e60-42ab-8b5b-5465268f68bb tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:47:19.386896 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_api:SELECT=66 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:47:19.392046 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-bcc39173-4e60-42ab-8b5b-5465268f68bb tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:19.392522 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-bcc39173-4e60-42ab-8b5b-5465268f68bb tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:19.392945 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-bcc39173-4e60-42ab-8b5b-5465268f68bb tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:19.393642 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-bcc39173-4e60-42ab-8b5b-5465268f68bb tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:19.394113 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-bcc39173-4e60-42ab-8b5b-5465268f68bb tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:19.394559 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-bcc39173-4e60-42ab-8b5b-5465268f68bb tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:19.529522 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-bcc39173-4e60-42ab-8b5b-5465268f68bb tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:19.538132 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-bcc39173-4e60-42ab-8b5b-5465268f68bb tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:19.539767 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-bcc39173-4e60-42ab-8b5b-5465268f68bb tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:19.541005 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-bcc39173-4e60-42ab-8b5b-5465268f68bb tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 200 len: 1741 microversion: 2.20 time: 0.161060 Aug 09 02:47:19.541648 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 440/911] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:47:19 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 1741 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:47:19.834563 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-623450e0-d91c-4fe6-981a-f19d878b61ae tempest-VolumesGetTestJSON-859469408 tempest-VolumesGetTestJSON-859469408-project] Action: 'create', calling method: .version_select at 0x7fb0a22ffa60>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2062604696", "metadata": {"Type": "work"}}} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:47:20.136019 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-623450e0-d91c-4fe6-981a-f19d878b61ae tempest-VolumesGetTestJSON-859469408 tempest-VolumesGetTestJSON-859469408-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.420689 Aug 09 02:47:20.136770 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 472/912] 10.222.0.20 () {60 vars in 1156 bytes} [Tue Aug 9 02:47:19 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 422 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 09 02:47:20.149184 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-aa05aab7-0059-42e5-a1fe-437c235b5222 tempest-VolumesGetTestJSON-859469408 tempest-VolumesGetTestJSON-859469408-project] Calling method '.version_select at 0x7fb0a057a670>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:20.198793 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-aa05aab7-0059-42e5-a1fe-437c235b5222 tempest-VolumesGetTestJSON-859469408 tempest-VolumesGetTestJSON-859469408-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/19e78114-1205-4be3-9f3e-324680e7cbeb" status: 200 len: 353 microversion: 2.1 time: 0.053501 Aug 09 02:47:20.199385 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 441/913] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Aug 9 02:47:20 2022] GET /compute/v2.1/os-volumes/19e78114-1205-4be3-9f3e-324680e7cbeb => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:47:20.568170 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-780e30b0-b730-4081-81cb-28964ff457b9 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:20.569160 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-780e30b0-b730-4081-81cb-28964ff457b9 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:47:20.579887 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-780e30b0-b730-4081-81cb-28964ff457b9 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:20.580343 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-780e30b0-b730-4081-81cb-28964ff457b9 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:20.580773 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-780e30b0-b730-4081-81cb-28964ff457b9 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:20.581457 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-780e30b0-b730-4081-81cb-28964ff457b9 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:20.581882 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-780e30b0-b730-4081-81cb-28964ff457b9 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:20.582336 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-780e30b0-b730-4081-81cb-28964ff457b9 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:20.714506 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-780e30b0-b730-4081-81cb-28964ff457b9 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:20.723619 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-780e30b0-b730-4081-81cb-28964ff457b9 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:20.725135 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-780e30b0-b730-4081-81cb-28964ff457b9 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:20.726343 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-780e30b0-b730-4081-81cb-28964ff457b9 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 200 len: 1741 microversion: 2.20 time: 0.164885 Aug 09 02:47:20.726907 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 473/914] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:47:20 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 1741 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:47:21.213624 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-efa0867b-ee25-49f0-a9c8-c9b211ac9d55 tempest-VolumesGetTestJSON-859469408 tempest-VolumesGetTestJSON-859469408-project] Calling method '.version_select at 0x7fb0a05001f0>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:21.260994 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-efa0867b-ee25-49f0-a9c8-c9b211ac9d55 tempest-VolumesGetTestJSON-859469408 tempest-VolumesGetTestJSON-859469408-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/19e78114-1205-4be3-9f3e-324680e7cbeb" status: 200 len: 354 microversion: 2.1 time: 0.051526 Aug 09 02:47:21.261464 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 442/915] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Aug 9 02:47:21 2022] GET /compute/v2.1/os-volumes/19e78114-1205-4be3-9f3e-324680e7cbeb => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:47:21.273988 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-e0a5ce2f-0594-43b0-8471-49e5f19e0670 tempest-VolumesGetTestJSON-859469408 tempest-VolumesGetTestJSON-859469408-project] Calling method '.version_select at 0x7fb0a0436160>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:21.319686 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-e0a5ce2f-0594-43b0-8471-49e5f19e0670 tempest-VolumesGetTestJSON-859469408 tempest-VolumesGetTestJSON-859469408-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/19e78114-1205-4be3-9f3e-324680e7cbeb" status: 200 len: 354 microversion: 2.1 time: 0.049849 Aug 09 02:47:21.320470 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 474/916] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Aug 9 02:47:21 2022] GET /compute/v2.1/os-volumes/19e78114-1205-4be3-9f3e-324680e7cbeb => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:47:21.337571 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-355fd23c-0ade-482f-8677-91029692e837 tempest-VolumesGetTestJSON-859469408 tempest-VolumesGetTestJSON-859469408-project] Calling method '.version_select at 0x7fb0a050eee0>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:21.402949 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-355fd23c-0ade-482f-8677-91029692e837 tempest-VolumesGetTestJSON-859469408 tempest-VolumesGetTestJSON-859469408-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/19e78114-1205-4be3-9f3e-324680e7cbeb" status: 202 len: 0 microversion: 2.1 time: 0.069094 Aug 09 02:47:21.403865 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 443/917] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Aug 9 02:47:21 2022] DELETE /compute/v2.1/os-volumes/19e78114-1205-4be3-9f3e-324680e7cbeb => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 02:47:21.415476 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-184e07ac-d3d4-4569-9d20-add146b16b13 tempest-VolumesGetTestJSON-859469408 tempest-VolumesGetTestJSON-859469408-project] Calling method '.version_select at 0x7fb0a04210d0>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:21.473477 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-184e07ac-d3d4-4569-9d20-add146b16b13 tempest-VolumesGetTestJSON-859469408 tempest-VolumesGetTestJSON-859469408-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/19e78114-1205-4be3-9f3e-324680e7cbeb" status: 200 len: 353 microversion: 2.1 time: 0.064707 Aug 09 02:47:21.474128 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 475/918] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Aug 9 02:47:21 2022] GET /compute/v2.1/os-volumes/19e78114-1205-4be3-9f3e-324680e7cbeb => generated 353 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:47:21.750697 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-1ca02bb7-7955-4353-99fd-290313b19c5c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:21.751649 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-1ca02bb7-7955-4353-99fd-290313b19c5c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:47:21.771040 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1ca02bb7-7955-4353-99fd-290313b19c5c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:21.771774 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1ca02bb7-7955-4353-99fd-290313b19c5c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:21.772378 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1ca02bb7-7955-4353-99fd-290313b19c5c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:21.773554 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1ca02bb7-7955-4353-99fd-290313b19c5c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:21.774378 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1ca02bb7-7955-4353-99fd-290313b19c5c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:21.775416 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1ca02bb7-7955-4353-99fd-290313b19c5c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:21.936673 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-1ca02bb7-7955-4353-99fd-290313b19c5c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:21.946125 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-1ca02bb7-7955-4353-99fd-290313b19c5c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:21.947618 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-1ca02bb7-7955-4353-99fd-290313b19c5c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:21.949022 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-1ca02bb7-7955-4353-99fd-290313b19c5c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 200 len: 1736 microversion: 2.20 time: 0.203739 Aug 09 02:47:21.949651 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 444/919] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:47:21 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 1736 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:47:22.487273 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-76471d06-db5a-4a38-ba74-ce92e1fcfa07 tempest-VolumesGetTestJSON-859469408 tempest-VolumesGetTestJSON-859469408-project] Calling method '.version_select at 0x7fb0a0421700>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:22.530832 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.wsgi [None req-76471d06-db5a-4a38-ba74-ce92e1fcfa07 tempest-VolumesGetTestJSON-859469408 tempest-VolumesGetTestJSON-859469408-project] HTTP exception thrown: Volume 19e78114-1205-4be3-9f3e-324680e7cbeb could not be found. Aug 09 02:47:22.533027 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-76471d06-db5a-4a38-ba74-ce92e1fcfa07 tempest-VolumesGetTestJSON-859469408 tempest-VolumesGetTestJSON-859469408-project] Request method failure captured: Aug 09 02:47:22.533027 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: request: GET /compute/v2.1/os-volumes/19e78114-1205-4be3-9f3e-324680e7cbeb HTTP/1.1 Aug 09 02:47:22.533027 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Accept: application/json Aug 09 02:47:22.533027 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Accept-Encoding: identity Aug 09 02:47:22.533027 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Connection: close Aug 09 02:47:22.533027 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Content-Length: 0 Aug 09 02:47:22.533027 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Content-Type: application/json Aug 09 02:47:22.533027 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Host: 10.222.0.20 Aug 09 02:47:22.533027 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Openstack-System-Scope: None Aug 09 02:47:22.533027 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: User-Agent: python-urllib3/1.26.11 Aug 09 02:47:22.533027 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Auth-Token: gAAAAABi8cq39jeTBRMJw1d4gKhgH1oFAdDeI38N2-2_FFbnWE18C5qD2jCMSk2NQ2UsL_lk4R3zo_zb0-Pfg6I5Qa8vDGpnxuyvos5ATUED_qppsbeRUboMySaefTWgCkQ1Qnoqn2PE6F7u1fXTUUrB_LxQnjUGQ4SrYXif9DGkRM__fJpWo70 Aug 09 02:47:22.533027 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Domain-Id: None Aug 09 02:47:22.533027 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Domain-Name: None Aug 09 02:47:22.533027 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Identity-Status: Confirmed Aug 09 02:47:22.533027 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Is-Admin-Project: True Aug 09 02:47:22.533027 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Domain-Id: default Aug 09 02:47:22.533027 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Domain-Name: Default Aug 09 02:47:22.533027 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Id: 96979d19de8a4c479a6538a6b35f8798 Aug 09 02:47:22.533027 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Name: tempest-VolumesGetTestJSON-859469408 Aug 09 02:47:22.533027 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Role: reader,member Aug 09 02:47:22.533027 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Roles: reader,member Aug 09 02:47:22.535036 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/96979d19de8a4c479a6538a6b35f8798"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/96979d19de8a4c479a6538a6b35f8798"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_96979d19de8a4c479a6538a6b35f8798"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/96979d19de8a4c479a6538a6b35f8798"}]}] Aug 09 02:47:22.535036 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant: tempest-VolumesGetTestJSON-859469408 Aug 09 02:47:22.535036 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant-Id: 96979d19de8a4c479a6538a6b35f8798 Aug 09 02:47:22.535036 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant-Name: tempest-VolumesGetTestJSON-859469408 Aug 09 02:47:22.535036 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User: tempest-VolumesGetTestJSON-859469408-project Aug 09 02:47:22.535036 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Domain-Id: default Aug 09 02:47:22.535036 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Domain-Name: Default Aug 09 02:47:22.535036 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Id: e8ee2ac0e2de411abec414e3dee9bedb Aug 09 02:47:22.535036 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Name: tempest-VolumesGetTestJSON-859469408-project Aug 09 02:47:22.535036 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: method: Aug 09 02:47:22.535036 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: exception: Volume 19e78114-1205-4be3-9f3e-324680e7cbeb could not be found. Aug 09 02:47:22.535036 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: action_args: {'id': '19e78114-1205-4be3-9f3e-324680e7cbeb'} Aug 09 02:47:22.535036 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 02:47:22.536207 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:22.536207 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 02:47:22.536207 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 02:47:22.536207 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 02:47:22.536207 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 02:47:22.536207 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 02:47:22.536207 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 02:47:22.536207 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 02:47:22.536207 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 02:47:22.536207 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 02:47:22.536207 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 02:47:22.536207 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 02:47:22.536207 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 02:47:22.536207 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 02:47:22.536207 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 02:47:22.536207 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 19e78114-1205-4be3-9f3e-324680e7cbeb could not be found. (HTTP 404) (Request-ID: req-807caa90-b28b-475d-92b7-e738bc0ca139) Aug 09 02:47:22.536207 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:22.536207 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:47:22.536207 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:22.537648 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:22.537648 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 09 02:47:22.537648 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 09 02:47:22.537648 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 02:47:22.537648 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 02:47:22.537648 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 02:47:22.537648 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 02:47:22.537648 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 02:47:22.537648 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 02:47:22.537648 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 02:47:22.537648 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 02:47:22.537648 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 02:47:22.537648 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 02:47:22.537648 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 02:47:22.537648 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 02:47:22.537648 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 02:47:22.537648 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 02:47:22.537648 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 02:47:22.537648 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 02:47:22.538988 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 02:47:22.538988 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 02:47:22.538988 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 02:47:22.538988 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 02:47:22.538988 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 19e78114-1205-4be3-9f3e-324680e7cbeb could not be found. Aug 09 02:47:22.538988 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:22.538988 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:47:22.538988 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:22.538988 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:22.538988 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:47:22.538988 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:47:22.538988 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 02:47:22.538988 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 02:47:22.538988 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 02:47:22.538988 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 02:47:22.538988 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 02:47:22.538988 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 02:47:22.538988 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 09 02:47:22.538988 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 02:47:22.540352 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 19e78114-1205-4be3-9f3e-324680e7cbeb could not be found. Aug 09 02:47:22.540352 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:22.540352 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:47:22.540352 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:22.540352 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:47:22.540352 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:47:22.540352 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:47:22.540352 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 02:47:22.540352 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 02:47:22.540352 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 19e78114-1205-4be3-9f3e-324680e7cbeb could not be found. Aug 09 02:47:22.540352 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:47:22.540352 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-76471d06-db5a-4a38-ba74-ce92e1fcfa07 tempest-VolumesGetTestJSON-859469408 tempest-VolumesGetTestJSON-859469408-project] Returning 404 to user: Volume 19e78114-1205-4be3-9f3e-324680e7cbeb could not be found. {{(pid=124427) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 02:47:22.540352 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-76471d06-db5a-4a38-ba74-ce92e1fcfa07 tempest-VolumesGetTestJSON-859469408 tempest-VolumesGetTestJSON-859469408-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/19e78114-1205-4be3-9f3e-324680e7cbeb" status: 404 len: 109 microversion: 2.1 time: 0.050954 Aug 09 02:47:22.540352 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 476/920] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Aug 9 02:47:22 2022] GET /compute/v2.1/os-volumes/19e78114-1205-4be3-9f3e-324680e7cbeb => generated 109 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 02:47:22.781545 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [req-eb855e1a-1f9f-409f-9e22-1199a2f12025 req-5e14a47e-2fd0-4647-a92d-bf43bb094e9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01aef713-9cfa-4840-829f-b5d30b2f9549", "name": "network-vif-plugged", "status": "completed", "tag": "c771a4c1-387c-4632-a527-0af0b51cc089"}]} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:47:22.796750 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-eb855e1a-1f9f-409f-9e22-1199a2f12025 req-5e14a47e-2fd0-4647-a92d-bf43bb094e9b service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:22.797308 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-eb855e1a-1f9f-409f-9e22-1199a2f12025 req-5e14a47e-2fd0-4647-a92d-bf43bb094e9b service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:22.798011 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-eb855e1a-1f9f-409f-9e22-1199a2f12025 req-5e14a47e-2fd0-4647-a92d-bf43bb094e9b service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:22.812577 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.compute.server_external_events [req-eb855e1a-1f9f-409f-9e22-1199a2f12025 req-5e14a47e-2fd0-4647-a92d-bf43bb094e9b service nova] Creating event network-vif-plugged:c771a4c1-387c-4632-a527-0af0b51cc089 for instance 01aef713-9cfa-4840-829f-b5d30b2f9549 on hv-cinder-85246 Aug 09 02:47:22.818618 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [req-eb855e1a-1f9f-409f-9e22-1199a2f12025 req-5e14a47e-2fd0-4647-a92d-bf43bb094e9b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042478 Aug 09 02:47:22.819637 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 445/921] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:47:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:47:22.976434 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-d379c15d-4391-4288-a4aa-5b5fa8d78d77 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:22.977210 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-d379c15d-4391-4288-a4aa-5b5fa8d78d77 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:47:22.989918 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d379c15d-4391-4288-a4aa-5b5fa8d78d77 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:22.991031 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d379c15d-4391-4288-a4aa-5b5fa8d78d77 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:22.993405 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d379c15d-4391-4288-a4aa-5b5fa8d78d77 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:22.994407 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d379c15d-4391-4288-a4aa-5b5fa8d78d77 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:22.997118 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d379c15d-4391-4288-a4aa-5b5fa8d78d77 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:22.997785 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-d379c15d-4391-4288-a4aa-5b5fa8d78d77 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:23.205567 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-d379c15d-4391-4288-a4aa-5b5fa8d78d77 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:23.215952 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-d379c15d-4391-4288-a4aa-5b5fa8d78d77 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:23.217833 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-d379c15d-4391-4288-a4aa-5b5fa8d78d77 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:23.219260 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-d379c15d-4391-4288-a4aa-5b5fa8d78d77 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 200 len: 1736 microversion: 2.20 time: 0.247064 Aug 09 02:47:23.220112 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 477/922] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:47:22 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 1736 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:47:24.243871 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-b540753e-65f8-46f1-86ba-3e20fac43528 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:24.244572 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-b540753e-65f8-46f1-86ba-3e20fac43528 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:47:24.252006 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b540753e-65f8-46f1-86ba-3e20fac43528 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:24.252501 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b540753e-65f8-46f1-86ba-3e20fac43528 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:24.254182 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b540753e-65f8-46f1-86ba-3e20fac43528 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:24.254952 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b540753e-65f8-46f1-86ba-3e20fac43528 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:24.255410 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b540753e-65f8-46f1-86ba-3e20fac43528 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:24.255836 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b540753e-65f8-46f1-86ba-3e20fac43528 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:24.421081 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-b540753e-65f8-46f1-86ba-3e20fac43528 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:24.430700 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-b540753e-65f8-46f1-86ba-3e20fac43528 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:24.432365 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-b540753e-65f8-46f1-86ba-3e20fac43528 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:24.433553 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-b540753e-65f8-46f1-86ba-3e20fac43528 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 200 len: 1736 microversion: 2.20 time: 0.193932 Aug 09 02:47:24.434120 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 446/923] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:47:24 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 1736 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:47:25.463667 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-bf18e396-44a7-4500-bdbc-05be80c04cb2 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:25.464497 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-bf18e396-44a7-4500-bdbc-05be80c04cb2 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:47:25.487638 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-bf18e396-44a7-4500-bdbc-05be80c04cb2 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:25.489153 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-bf18e396-44a7-4500-bdbc-05be80c04cb2 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:25.489831 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-bf18e396-44a7-4500-bdbc-05be80c04cb2 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:25.490798 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-bf18e396-44a7-4500-bdbc-05be80c04cb2 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:25.491467 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-bf18e396-44a7-4500-bdbc-05be80c04cb2 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:25.492119 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-bf18e396-44a7-4500-bdbc-05be80c04cb2 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:25.497031 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_cell1:SELECT=100 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:47:25.697721 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-bf18e396-44a7-4500-bdbc-05be80c04cb2 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:25.707423 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-bf18e396-44a7-4500-bdbc-05be80c04cb2 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:25.709141 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-bf18e396-44a7-4500-bdbc-05be80c04cb2 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:25.710597 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-bf18e396-44a7-4500-bdbc-05be80c04cb2 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 200 len: 1736 microversion: 2.20 time: 0.251318 Aug 09 02:47:25.711635 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 478/924] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:47:25 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 1736 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:47:26.736419 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-2e46dac0-5dfa-461a-a977-c77ffd93a018 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:26.737134 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-2e46dac0-5dfa-461a-a977-c77ffd93a018 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:47:26.756444 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2e46dac0-5dfa-461a-a977-c77ffd93a018 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:26.756947 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2e46dac0-5dfa-461a-a977-c77ffd93a018 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:26.758822 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2e46dac0-5dfa-461a-a977-c77ffd93a018 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:26.762862 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2e46dac0-5dfa-461a-a977-c77ffd93a018 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:26.763396 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2e46dac0-5dfa-461a-a977-c77ffd93a018 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:26.765100 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2e46dac0-5dfa-461a-a977-c77ffd93a018 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:27.003670 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-2e46dac0-5dfa-461a-a977-c77ffd93a018 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:27.022212 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-2e46dac0-5dfa-461a-a977-c77ffd93a018 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:27.026536 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-2e46dac0-5dfa-461a-a977-c77ffd93a018 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:27.032916 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-2e46dac0-5dfa-461a-a977-c77ffd93a018 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 200 len: 1736 microversion: 2.20 time: 0.298866 Aug 09 02:47:27.034189 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 447/925] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:47:26 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 1736 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:47:28.056566 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-143d9621-152a-4691-b240-d09062148775 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:28.057175 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-143d9621-152a-4691-b240-d09062148775 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:47:28.065005 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-143d9621-152a-4691-b240-d09062148775 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:28.065467 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-143d9621-152a-4691-b240-d09062148775 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:28.066083 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-143d9621-152a-4691-b240-d09062148775 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:28.067077 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-143d9621-152a-4691-b240-d09062148775 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:28.067685 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-143d9621-152a-4691-b240-d09062148775 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:28.068265 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-143d9621-152a-4691-b240-d09062148775 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:28.353336 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-143d9621-152a-4691-b240-d09062148775 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:28.367884 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-143d9621-152a-4691-b240-d09062148775 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:28.374291 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-143d9621-152a-4691-b240-d09062148775 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:28.375860 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-143d9621-152a-4691-b240-d09062148775 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 200 len: 1736 microversion: 2.20 time: 0.323423 Aug 09 02:47:28.377010 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 479/926] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:47:28 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 1736 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:47:29.398847 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-c7af903d-bb1c-43e3-a2d7-53d409bea2e5 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:29.399659 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-c7af903d-bb1c-43e3-a2d7-53d409bea2e5 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:47:29.406319 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c7af903d-bb1c-43e3-a2d7-53d409bea2e5 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:29.407040 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c7af903d-bb1c-43e3-a2d7-53d409bea2e5 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:29.407712 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c7af903d-bb1c-43e3-a2d7-53d409bea2e5 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:29.408702 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c7af903d-bb1c-43e3-a2d7-53d409bea2e5 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:29.409440 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c7af903d-bb1c-43e3-a2d7-53d409bea2e5 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:29.410010 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c7af903d-bb1c-43e3-a2d7-53d409bea2e5 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:29.637520 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-c7af903d-bb1c-43e3-a2d7-53d409bea2e5 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:29.650366 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-c7af903d-bb1c-43e3-a2d7-53d409bea2e5 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:29.652049 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-c7af903d-bb1c-43e3-a2d7-53d409bea2e5 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:29.653367 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-c7af903d-bb1c-43e3-a2d7-53d409bea2e5 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 200 len: 1736 microversion: 2.20 time: 0.258588 Aug 09 02:47:29.654267 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 448/927] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:47:29 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 1736 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:47:30.681449 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-61e031a9-8644-441d-b4f7-4c9bbc4c01f4 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:30.682925 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-61e031a9-8644-441d-b4f7-4c9bbc4c01f4 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:47:30.691494 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-61e031a9-8644-441d-b4f7-4c9bbc4c01f4 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:30.692254 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-61e031a9-8644-441d-b4f7-4c9bbc4c01f4 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:30.692838 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-61e031a9-8644-441d-b4f7-4c9bbc4c01f4 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:30.693706 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-61e031a9-8644-441d-b4f7-4c9bbc4c01f4 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:30.694340 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-61e031a9-8644-441d-b4f7-4c9bbc4c01f4 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:30.694911 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-61e031a9-8644-441d-b4f7-4c9bbc4c01f4 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:30.862442 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-61e031a9-8644-441d-b4f7-4c9bbc4c01f4 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:30.872017 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-61e031a9-8644-441d-b4f7-4c9bbc4c01f4 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:30.873740 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-61e031a9-8644-441d-b4f7-4c9bbc4c01f4 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:30.875227 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-61e031a9-8644-441d-b4f7-4c9bbc4c01f4 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 200 len: 1736 microversion: 2.20 time: 0.197929 Aug 09 02:47:30.876539 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 480/928] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:47:30 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 1736 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:47:31.897976 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-7645fb3b-17dd-4157-9ba0-71f25cb3af9f tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:31.899307 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-7645fb3b-17dd-4157-9ba0-71f25cb3af9f tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:47:31.905883 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7645fb3b-17dd-4157-9ba0-71f25cb3af9f tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:31.906387 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7645fb3b-17dd-4157-9ba0-71f25cb3af9f tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:31.906817 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7645fb3b-17dd-4157-9ba0-71f25cb3af9f tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:31.907562 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7645fb3b-17dd-4157-9ba0-71f25cb3af9f tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:31.908005 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7645fb3b-17dd-4157-9ba0-71f25cb3af9f tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:31.908436 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7645fb3b-17dd-4157-9ba0-71f25cb3af9f tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:32.048085 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-7645fb3b-17dd-4157-9ba0-71f25cb3af9f tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:32.057170 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-7645fb3b-17dd-4157-9ba0-71f25cb3af9f tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:32.058781 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-7645fb3b-17dd-4157-9ba0-71f25cb3af9f tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:32.060001 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-7645fb3b-17dd-4157-9ba0-71f25cb3af9f tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 200 len: 1736 microversion: 2.20 time: 0.166052 Aug 09 02:47:32.060865 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 449/929] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:47:31 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:47:33.086130 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-40e6341a-11d9-4f0d-b96b-ec60cb08df6a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:33.086778 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-40e6341a-11d9-4f0d-b96b-ec60cb08df6a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:47:33.094166 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-40e6341a-11d9-4f0d-b96b-ec60cb08df6a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:33.094980 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-40e6341a-11d9-4f0d-b96b-ec60cb08df6a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:33.095692 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-40e6341a-11d9-4f0d-b96b-ec60cb08df6a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:33.096801 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-40e6341a-11d9-4f0d-b96b-ec60cb08df6a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:33.097670 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-40e6341a-11d9-4f0d-b96b-ec60cb08df6a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:33.098380 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-40e6341a-11d9-4f0d-b96b-ec60cb08df6a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:33.311633 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-40e6341a-11d9-4f0d-b96b-ec60cb08df6a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:33.320090 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-40e6341a-11d9-4f0d-b96b-ec60cb08df6a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:33.321594 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-40e6341a-11d9-4f0d-b96b-ec60cb08df6a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:33.322881 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-40e6341a-11d9-4f0d-b96b-ec60cb08df6a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 200 len: 1718 microversion: 2.20 time: 0.243593 Aug 09 02:47:33.323598 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 481/930] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:47:33 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 1718 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:47:34.350377 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-3952c6bc-9f54-4019-8a26-db5ba3c0a3f3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:34.350977 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-3952c6bc-9f54-4019-8a26-db5ba3c0a3f3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:47:34.357443 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3952c6bc-9f54-4019-8a26-db5ba3c0a3f3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:34.357912 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3952c6bc-9f54-4019-8a26-db5ba3c0a3f3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:34.358373 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3952c6bc-9f54-4019-8a26-db5ba3c0a3f3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:34.359052 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3952c6bc-9f54-4019-8a26-db5ba3c0a3f3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:34.359490 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3952c6bc-9f54-4019-8a26-db5ba3c0a3f3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:34.359929 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3952c6bc-9f54-4019-8a26-db5ba3c0a3f3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:34.504551 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-3952c6bc-9f54-4019-8a26-db5ba3c0a3f3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:34.514123 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-3952c6bc-9f54-4019-8a26-db5ba3c0a3f3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:34.515953 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-3952c6bc-9f54-4019-8a26-db5ba3c0a3f3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:34.517093 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-3952c6bc-9f54-4019-8a26-db5ba3c0a3f3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 200 len: 1718 microversion: 2.20 time: 0.172297 Aug 09 02:47:34.517647 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 450/931] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:47:34 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 1718 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:47:35.545278 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-46006de3-ea4d-4c22-840e-0f5dbffe7ec6 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:35.546324 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-46006de3-ea4d-4c22-840e-0f5dbffe7ec6 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:47:35.553886 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-46006de3-ea4d-4c22-840e-0f5dbffe7ec6 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:35.554427 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-46006de3-ea4d-4c22-840e-0f5dbffe7ec6 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:35.554862 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-46006de3-ea4d-4c22-840e-0f5dbffe7ec6 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:35.555551 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-46006de3-ea4d-4c22-840e-0f5dbffe7ec6 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:35.556009 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-46006de3-ea4d-4c22-840e-0f5dbffe7ec6 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:35.556433 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-46006de3-ea4d-4c22-840e-0f5dbffe7ec6 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:35.685776 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-46006de3-ea4d-4c22-840e-0f5dbffe7ec6 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:35.694844 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-46006de3-ea4d-4c22-840e-0f5dbffe7ec6 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:35.696355 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-46006de3-ea4d-4c22-840e-0f5dbffe7ec6 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:35.697516 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-46006de3-ea4d-4c22-840e-0f5dbffe7ec6 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 200 len: 1661 microversion: 2.20 time: 0.159321 Aug 09 02:47:35.698060 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 482/932] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:47:35 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 1661 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:47:35.719013 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-0a57cd23-7f3c-487f-a6fa-1e3a47370757 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5fe3209a-3463-4ecd-be65-53a6be4738d3"}} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:47:35.721499 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-0a57cd23-7f3c-487f-a6fa-1e3a47370757 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:47:35.727914 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0a57cd23-7f3c-487f-a6fa-1e3a47370757 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:35.728389 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0a57cd23-7f3c-487f-a6fa-1e3a47370757 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:35.728811 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0a57cd23-7f3c-487f-a6fa-1e3a47370757 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:35.729493 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0a57cd23-7f3c-487f-a6fa-1e3a47370757 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:35.729935 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0a57cd23-7f3c-487f-a6fa-1e3a47370757 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:35.730392 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0a57cd23-7f3c-487f-a6fa-1e3a47370757 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:36.098377 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-0a57cd23-7f3c-487f-a6fa-1e3a47370757 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "POST /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.383176 Aug 09 02:47:36.099194 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 451/933] 10.222.0.20 () {62 vars in 1364 bytes} [Tue Aug 9 02:47:35 2022] POST /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549/os-volume_attachments => generated 188 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 02:47:36.246307 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-64d8c0f1-08a0-4ac5-9637-74aa868fa5fa tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:36.246823 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-64d8c0f1-08a0-4ac5-9637-74aa868fa5fa tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:47:36.253070 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-64d8c0f1-08a0-4ac5-9637-74aa868fa5fa tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:36.253592 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-64d8c0f1-08a0-4ac5-9637-74aa868fa5fa tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:36.254028 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-64d8c0f1-08a0-4ac5-9637-74aa868fa5fa tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:36.254762 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-64d8c0f1-08a0-4ac5-9637-74aa868fa5fa tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:36.255210 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-64d8c0f1-08a0-4ac5-9637-74aa868fa5fa tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:36.255628 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-64d8c0f1-08a0-4ac5-9637-74aa868fa5fa tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:36.536192 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-64d8c0f1-08a0-4ac5-9637-74aa868fa5fa tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "DELETE /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549/os-volume_attachments/5fe3209a-3463-4ecd-be65-53a6be4738d3" status: 202 len: 0 microversion: 2.20 time: 0.294016 Aug 09 02:47:36.536787 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 483/934] 10.222.0.20 () {60 vars in 1457 bytes} [Tue Aug 9 02:47:36 2022] DELETE /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549/os-volume_attachments/5fe3209a-3463-4ecd-be65-53a6be4738d3 => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 02:47:36.597399 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-37a0e794-ed8e-4d43-a26c-ba0189e9d5ec tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:47:36.597999 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-37a0e794-ed8e-4d43-a26c-ba0189e9d5ec tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:47:36.604171 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-37a0e794-ed8e-4d43-a26c-ba0189e9d5ec tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:36.604655 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-37a0e794-ed8e-4d43-a26c-ba0189e9d5ec tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:36.605058 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-37a0e794-ed8e-4d43-a26c-ba0189e9d5ec tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:36.605776 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-37a0e794-ed8e-4d43-a26c-ba0189e9d5ec tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:36.606259 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-37a0e794-ed8e-4d43-a26c-ba0189e9d5ec tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:36.606678 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-37a0e794-ed8e-4d43-a26c-ba0189e9d5ec tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:36.639250 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-37a0e794-ed8e-4d43-a26c-ba0189e9d5ec tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124425) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 09 02:47:36.713968 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-37a0e794-ed8e-4d43-a26c-ba0189e9d5ec tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "POST /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549/action" status: 202 len: 0 microversion: 2.20 time: 0.120475 Aug 09 02:47:36.714673 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 452/935] 10.222.0.20 () {62 vars in 1319 bytes} [Tue Aug 9 02:47:36 2022] POST /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 02:47:36.723006 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-40e19c20-070e-4e94-a067-6b2a621f5c6c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:36.723781 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-40e19c20-070e-4e94-a067-6b2a621f5c6c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:47:36.733561 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-40e19c20-070e-4e94-a067-6b2a621f5c6c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:36.734681 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-40e19c20-070e-4e94-a067-6b2a621f5c6c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:36.741189 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-40e19c20-070e-4e94-a067-6b2a621f5c6c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:36.746251 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-40e19c20-070e-4e94-a067-6b2a621f5c6c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:36.746808 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-40e19c20-070e-4e94-a067-6b2a621f5c6c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:36.747235 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-40e19c20-070e-4e94-a067-6b2a621f5c6c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:36.838337 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [req-ff6df2df-d826-4bc3-af28-ec38789c8b84 req-8135b49f-f49f-404a-8083-d24689e0d460 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01aef713-9cfa-4840-829f-b5d30b2f9549", "name": "network-vif-unplugged", "status": "completed", "tag": "c771a4c1-387c-4632-a527-0af0b51cc089"}]} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:47:36.849610 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-ff6df2df-d826-4bc3-af28-ec38789c8b84 req-8135b49f-f49f-404a-8083-d24689e0d460 service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:36.850090 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-ff6df2df-d826-4bc3-af28-ec38789c8b84 req-8135b49f-f49f-404a-8083-d24689e0d460 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:36.850744 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-ff6df2df-d826-4bc3-af28-ec38789c8b84 req-8135b49f-f49f-404a-8083-d24689e0d460 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:36.864773 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.compute.server_external_events [req-ff6df2df-d826-4bc3-af28-ec38789c8b84 req-8135b49f-f49f-404a-8083-d24689e0d460 service nova] Unable to find a host for instance 01aef713-9cfa-4840-829f-b5d30b2f9549. Dropping event network-vif-unplugged {{(pid=124425) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 09 02:47:36.865731 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [req-ff6df2df-d826-4bc3-af28-ec38789c8b84 req-8135b49f-f49f-404a-8083-d24689e0d460 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031500 Aug 09 02:47:36.866351 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 453/936] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:47:36 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 09 02:47:36.931297 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-40e19c20-070e-4e94-a067-6b2a621f5c6c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:36.939293 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-40e19c20-070e-4e94-a067-6b2a621f5c6c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:36.941351 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-40e19c20-070e-4e94-a067-6b2a621f5c6c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:36.942655 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-40e19c20-070e-4e94-a067-6b2a621f5c6c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 200 len: 1669 microversion: 2.20 time: 0.223624 Aug 09 02:47:36.943218 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 484/937] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:47:36 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 1669 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 02:47:37.965935 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-fec16236-1dc0-44d9-98c0-22fe07327e65 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:37.972136 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-fec16236-1dc0-44d9-98c0-22fe07327e65 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:47:37.980801 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-fec16236-1dc0-44d9-98c0-22fe07327e65 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:37.981285 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-fec16236-1dc0-44d9-98c0-22fe07327e65 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:37.981709 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-fec16236-1dc0-44d9-98c0-22fe07327e65 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:37.982608 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-fec16236-1dc0-44d9-98c0-22fe07327e65 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:37.983050 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-fec16236-1dc0-44d9-98c0-22fe07327e65 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:37.983509 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-fec16236-1dc0-44d9-98c0-22fe07327e65 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:38.129061 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-fec16236-1dc0-44d9-98c0-22fe07327e65 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:38.137861 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-fec16236-1dc0-44d9-98c0-22fe07327e65 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:38.139386 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-fec16236-1dc0-44d9-98c0-22fe07327e65 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:38.140536 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-fec16236-1dc0-44d9-98c0-22fe07327e65 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 200 len: 1727 microversion: 2.20 time: 0.179460 Aug 09 02:47:38.141390 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 454/938] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:47:37 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 1727 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:47:39.163924 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-751b766b-2de0-4cf5-ac86-062f7627bc44 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:39.164526 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-751b766b-2de0-4cf5-ac86-062f7627bc44 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:47:39.166843 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_api:SELECT=26 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:47:39.172119 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-751b766b-2de0-4cf5-ac86-062f7627bc44 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:39.172581 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-751b766b-2de0-4cf5-ac86-062f7627bc44 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:39.173013 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-751b766b-2de0-4cf5-ac86-062f7627bc44 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:39.173685 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-751b766b-2de0-4cf5-ac86-062f7627bc44 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:39.174319 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-751b766b-2de0-4cf5-ac86-062f7627bc44 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:39.174737 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-751b766b-2de0-4cf5-ac86-062f7627bc44 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:39.305353 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-751b766b-2de0-4cf5-ac86-062f7627bc44 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:39.313663 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-751b766b-2de0-4cf5-ac86-062f7627bc44 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:39.315379 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-751b766b-2de0-4cf5-ac86-062f7627bc44 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:39.316608 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-751b766b-2de0-4cf5-ac86-062f7627bc44 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 200 len: 1727 microversion: 2.20 time: 0.156620 Aug 09 02:47:39.317252 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 485/939] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:47:39 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:47:40.340363 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-37d12995-e4cc-4862-b37a-3f1b06a63a75 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:40.341232 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-37d12995-e4cc-4862-b37a-3f1b06a63a75 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:47:40.348453 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-37d12995-e4cc-4862-b37a-3f1b06a63a75 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:40.349033 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-37d12995-e4cc-4862-b37a-3f1b06a63a75 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:40.349576 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-37d12995-e4cc-4862-b37a-3f1b06a63a75 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:40.350380 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-37d12995-e4cc-4862-b37a-3f1b06a63a75 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:40.350988 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-37d12995-e4cc-4862-b37a-3f1b06a63a75 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:40.351643 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-37d12995-e4cc-4862-b37a-3f1b06a63a75 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:40.572740 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-37d12995-e4cc-4862-b37a-3f1b06a63a75 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:40.575289 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:47:40.583195 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-37d12995-e4cc-4862-b37a-3f1b06a63a75 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:40.584764 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-37d12995-e4cc-4862-b37a-3f1b06a63a75 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:40.586010 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-37d12995-e4cc-4862-b37a-3f1b06a63a75 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 200 len: 1727 microversion: 2.20 time: 0.250381 Aug 09 02:47:40.586673 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 455/940] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:47:40 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 1727 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:47:41.608717 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-e8017aa7-297b-450f-b126-fff54b290a2c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:41.609267 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-e8017aa7-297b-450f-b126-fff54b290a2c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:47:41.616373 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e8017aa7-297b-450f-b126-fff54b290a2c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:41.616848 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e8017aa7-297b-450f-b126-fff54b290a2c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:41.617274 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e8017aa7-297b-450f-b126-fff54b290a2c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:41.617952 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e8017aa7-297b-450f-b126-fff54b290a2c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:41.618411 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e8017aa7-297b-450f-b126-fff54b290a2c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:41.618840 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e8017aa7-297b-450f-b126-fff54b290a2c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:41.750336 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-e8017aa7-297b-450f-b126-fff54b290a2c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:41.758717 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-e8017aa7-297b-450f-b126-fff54b290a2c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:41.760222 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-e8017aa7-297b-450f-b126-fff54b290a2c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:41.761695 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-e8017aa7-297b-450f-b126-fff54b290a2c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 200 len: 1727 microversion: 2.20 time: 0.156959 Aug 09 02:47:41.762449 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 486/941] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:47:41 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:47:42.792529 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-7bf2b225-e038-4fc4-b7f7-c7549c2cd901 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:42.793468 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-7bf2b225-e038-4fc4-b7f7-c7549c2cd901 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:47:42.804644 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7bf2b225-e038-4fc4-b7f7-c7549c2cd901 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:42.805123 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7bf2b225-e038-4fc4-b7f7-c7549c2cd901 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:42.805560 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7bf2b225-e038-4fc4-b7f7-c7549c2cd901 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:42.806284 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7bf2b225-e038-4fc4-b7f7-c7549c2cd901 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:42.806732 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7bf2b225-e038-4fc4-b7f7-c7549c2cd901 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:42.807151 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7bf2b225-e038-4fc4-b7f7-c7549c2cd901 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:42.952098 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-7bf2b225-e038-4fc4-b7f7-c7549c2cd901 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:42.960639 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-7bf2b225-e038-4fc4-b7f7-c7549c2cd901 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:42.962143 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-7bf2b225-e038-4fc4-b7f7-c7549c2cd901 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:42.963560 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-7bf2b225-e038-4fc4-b7f7-c7549c2cd901 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 200 len: 1727 microversion: 2.20 time: 0.179451 Aug 09 02:47:42.964126 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 456/942] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:47:42 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 1727 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:47:43.989299 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-4daf2b0f-98b8-4484-8e3e-83fd5bb98a18 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:43.991591 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-4daf2b0f-98b8-4484-8e3e-83fd5bb98a18 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:47:44.006991 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4daf2b0f-98b8-4484-8e3e-83fd5bb98a18 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:44.007565 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4daf2b0f-98b8-4484-8e3e-83fd5bb98a18 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:44.008475 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4daf2b0f-98b8-4484-8e3e-83fd5bb98a18 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:44.009301 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4daf2b0f-98b8-4484-8e3e-83fd5bb98a18 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:44.013896 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4daf2b0f-98b8-4484-8e3e-83fd5bb98a18 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:44.014622 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4daf2b0f-98b8-4484-8e3e-83fd5bb98a18 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:44.197494 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-4daf2b0f-98b8-4484-8e3e-83fd5bb98a18 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:44.213743 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-4daf2b0f-98b8-4484-8e3e-83fd5bb98a18 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:44.216359 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-4daf2b0f-98b8-4484-8e3e-83fd5bb98a18 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:44.217775 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-4daf2b0f-98b8-4484-8e3e-83fd5bb98a18 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 200 len: 1727 microversion: 2.20 time: 0.234973 Aug 09 02:47:44.218722 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 487/943] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:47:43 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 1727 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:47:45.254744 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-adae2e99-be97-4726-b8fd-e07be2ab8948 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:45.255973 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-adae2e99-be97-4726-b8fd-e07be2ab8948 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:47:45.263666 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-adae2e99-be97-4726-b8fd-e07be2ab8948 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:45.264613 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-adae2e99-be97-4726-b8fd-e07be2ab8948 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:45.265386 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-adae2e99-be97-4726-b8fd-e07be2ab8948 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:45.266293 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-adae2e99-be97-4726-b8fd-e07be2ab8948 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:45.267018 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-adae2e99-be97-4726-b8fd-e07be2ab8948 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:45.267672 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-adae2e99-be97-4726-b8fd-e07be2ab8948 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:45.470358 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-adae2e99-be97-4726-b8fd-e07be2ab8948 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:45.481647 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-adae2e99-be97-4726-b8fd-e07be2ab8948 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:45.483703 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-adae2e99-be97-4726-b8fd-e07be2ab8948 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:45.485303 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-adae2e99-be97-4726-b8fd-e07be2ab8948 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 200 len: 1727 microversion: 2.20 time: 0.239420 Aug 09 02:47:45.498868 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 457/944] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:47:45 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 1727 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:47:46.508944 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-142f4bc3-e611-4c54-8c08-3d8e0567253a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:46.510130 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-142f4bc3-e611-4c54-8c08-3d8e0567253a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:47:46.520478 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-142f4bc3-e611-4c54-8c08-3d8e0567253a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:46.520947 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-142f4bc3-e611-4c54-8c08-3d8e0567253a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:46.521656 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-142f4bc3-e611-4c54-8c08-3d8e0567253a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:46.522717 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-142f4bc3-e611-4c54-8c08-3d8e0567253a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:46.523165 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-142f4bc3-e611-4c54-8c08-3d8e0567253a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:46.523545 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-142f4bc3-e611-4c54-8c08-3d8e0567253a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:46.739650 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-142f4bc3-e611-4c54-8c08-3d8e0567253a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:46.750439 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-142f4bc3-e611-4c54-8c08-3d8e0567253a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:46.753058 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-142f4bc3-e611-4c54-8c08-3d8e0567253a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:46.754816 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-142f4bc3-e611-4c54-8c08-3d8e0567253a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 200 len: 1727 microversion: 2.20 time: 0.249398 Aug 09 02:47:46.755975 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 488/945] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:47:46 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 1727 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:47:47.784313 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-d7f07df5-8c41-4644-a2a0-b7ad632b916e tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:47.785598 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-d7f07df5-8c41-4644-a2a0-b7ad632b916e tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:47:47.794565 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d7f07df5-8c41-4644-a2a0-b7ad632b916e tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:47.795565 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d7f07df5-8c41-4644-a2a0-b7ad632b916e tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:47.796401 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d7f07df5-8c41-4644-a2a0-b7ad632b916e tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:47.797074 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d7f07df5-8c41-4644-a2a0-b7ad632b916e tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:47.797838 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d7f07df5-8c41-4644-a2a0-b7ad632b916e tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:47.798265 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d7f07df5-8c41-4644-a2a0-b7ad632b916e tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:47.977207 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-d7f07df5-8c41-4644-a2a0-b7ad632b916e tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:47.993621 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-d7f07df5-8c41-4644-a2a0-b7ad632b916e tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:47.995146 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-d7f07df5-8c41-4644-a2a0-b7ad632b916e tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:47.997030 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-d7f07df5-8c41-4644-a2a0-b7ad632b916e tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 200 len: 1727 microversion: 2.20 time: 0.219543 Aug 09 02:47:47.997770 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 458/946] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:47:47 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 1727 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:47:49.019942 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-483dae15-035f-4ad3-b17c-70375e157bee tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:49.021219 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-483dae15-035f-4ad3-b17c-70375e157bee tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:47:49.028241 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-483dae15-035f-4ad3-b17c-70375e157bee tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:49.028812 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-483dae15-035f-4ad3-b17c-70375e157bee tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:49.029151 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-483dae15-035f-4ad3-b17c-70375e157bee tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:49.029845 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-483dae15-035f-4ad3-b17c-70375e157bee tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:49.030413 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-483dae15-035f-4ad3-b17c-70375e157bee tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:49.030747 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-483dae15-035f-4ad3-b17c-70375e157bee tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:49.231325 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-483dae15-035f-4ad3-b17c-70375e157bee tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:49.240589 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-483dae15-035f-4ad3-b17c-70375e157bee tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:49.242682 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-483dae15-035f-4ad3-b17c-70375e157bee tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:49.244310 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-483dae15-035f-4ad3-b17c-70375e157bee tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 200 len: 1727 microversion: 2.20 time: 0.228382 Aug 09 02:47:49.245664 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 489/947] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:47:49 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 1727 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:47:50.270544 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-560ae539-41ae-4413-a076-8f44294d7e93 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:50.272209 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-560ae539-41ae-4413-a076-8f44294d7e93 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:47:50.279550 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:47:50.281387 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-560ae539-41ae-4413-a076-8f44294d7e93 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:50.282439 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-560ae539-41ae-4413-a076-8f44294d7e93 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:50.283140 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-560ae539-41ae-4413-a076-8f44294d7e93 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:50.284490 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-560ae539-41ae-4413-a076-8f44294d7e93 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:50.285153 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-560ae539-41ae-4413-a076-8f44294d7e93 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:50.285674 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-560ae539-41ae-4413-a076-8f44294d7e93 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:50.519113 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-560ae539-41ae-4413-a076-8f44294d7e93 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:50.528323 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-560ae539-41ae-4413-a076-8f44294d7e93 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:50.529824 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-560ae539-41ae-4413-a076-8f44294d7e93 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:50.535521 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-560ae539-41ae-4413-a076-8f44294d7e93 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 200 len: 1727 microversion: 2.20 time: 0.270180 Aug 09 02:47:50.536906 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 459/948] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:47:50 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 1727 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:47:51.563292 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-3278a552-0e55-471f-99ae-6ad0f541d30a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:51.564107 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-3278a552-0e55-471f-99ae-6ad0f541d30a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:47:51.578475 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3278a552-0e55-471f-99ae-6ad0f541d30a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:51.579181 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3278a552-0e55-471f-99ae-6ad0f541d30a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:51.580834 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3278a552-0e55-471f-99ae-6ad0f541d30a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:51.581916 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3278a552-0e55-471f-99ae-6ad0f541d30a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:51.582598 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3278a552-0e55-471f-99ae-6ad0f541d30a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:51.583223 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3278a552-0e55-471f-99ae-6ad0f541d30a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:51.726589 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-3278a552-0e55-471f-99ae-6ad0f541d30a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:51.734972 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-3278a552-0e55-471f-99ae-6ad0f541d30a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:51.736675 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-3278a552-0e55-471f-99ae-6ad0f541d30a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:51.738185 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-3278a552-0e55-471f-99ae-6ad0f541d30a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 200 len: 1727 microversion: 2.20 time: 0.181382 Aug 09 02:47:51.739091 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 490/949] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:47:51 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 1727 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 02:47:52.765443 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-bfae6d17-361b-49a3-8c6d-2dde88f58e02 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:52.766360 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-bfae6d17-361b-49a3-8c6d-2dde88f58e02 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:47:52.773918 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-bfae6d17-361b-49a3-8c6d-2dde88f58e02 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:52.774439 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-bfae6d17-361b-49a3-8c6d-2dde88f58e02 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:52.774870 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-bfae6d17-361b-49a3-8c6d-2dde88f58e02 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:52.775548 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-bfae6d17-361b-49a3-8c6d-2dde88f58e02 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:52.775995 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-bfae6d17-361b-49a3-8c6d-2dde88f58e02 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:52.776411 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-bfae6d17-361b-49a3-8c6d-2dde88f58e02 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:52.923849 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-bfae6d17-361b-49a3-8c6d-2dde88f58e02 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:52.932042 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-bfae6d17-361b-49a3-8c6d-2dde88f58e02 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:52.933646 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-bfae6d17-361b-49a3-8c6d-2dde88f58e02 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:52.934842 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-bfae6d17-361b-49a3-8c6d-2dde88f58e02 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 200 len: 1727 microversion: 2.20 time: 0.176198 Aug 09 02:47:52.935394 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 460/950] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:47:52 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 1727 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:47:53.957742 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-5f4a98c9-5552-4286-8f42-b22524e3e446 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:53.958384 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-5f4a98c9-5552-4286-8f42-b22524e3e446 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:47:53.965109 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5f4a98c9-5552-4286-8f42-b22524e3e446 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:53.965599 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5f4a98c9-5552-4286-8f42-b22524e3e446 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:53.966016 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5f4a98c9-5552-4286-8f42-b22524e3e446 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:53.966784 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5f4a98c9-5552-4286-8f42-b22524e3e446 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:53.967244 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5f4a98c9-5552-4286-8f42-b22524e3e446 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:53.967675 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-5f4a98c9-5552-4286-8f42-b22524e3e446 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:54.097227 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-5f4a98c9-5552-4286-8f42-b22524e3e446 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:54.105658 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-5f4a98c9-5552-4286-8f42-b22524e3e446 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:54.107199 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-5f4a98c9-5552-4286-8f42-b22524e3e446 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:54.108364 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-5f4a98c9-5552-4286-8f42-b22524e3e446 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 200 len: 1727 microversion: 2.20 time: 0.154751 Aug 09 02:47:54.108930 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 491/951] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:47:53 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:47:55.132470 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-36882ea5-201c-4548-a062-7695c4417266 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:55.133081 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-36882ea5-201c-4548-a062-7695c4417266 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:47:55.139463 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-36882ea5-201c-4548-a062-7695c4417266 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:55.139931 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-36882ea5-201c-4548-a062-7695c4417266 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:55.140526 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-36882ea5-201c-4548-a062-7695c4417266 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:55.141210 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-36882ea5-201c-4548-a062-7695c4417266 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:55.141652 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-36882ea5-201c-4548-a062-7695c4417266 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:55.142062 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-36882ea5-201c-4548-a062-7695c4417266 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:55.281834 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-36882ea5-201c-4548-a062-7695c4417266 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:55.290444 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-36882ea5-201c-4548-a062-7695c4417266 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:55.291964 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-36882ea5-201c-4548-a062-7695c4417266 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:55.293240 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-36882ea5-201c-4548-a062-7695c4417266 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 200 len: 1727 microversion: 2.20 time: 0.164683 Aug 09 02:47:55.293897 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 461/952] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:47:55 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:47:56.315964 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-8ff5ef91-31a0-4a3e-a9aa-59122496eb76 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:56.316553 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-8ff5ef91-31a0-4a3e-a9aa-59122496eb76 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:47:56.323034 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8ff5ef91-31a0-4a3e-a9aa-59122496eb76 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:56.323511 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8ff5ef91-31a0-4a3e-a9aa-59122496eb76 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:56.323954 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8ff5ef91-31a0-4a3e-a9aa-59122496eb76 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:56.324630 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8ff5ef91-31a0-4a3e-a9aa-59122496eb76 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:56.325069 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8ff5ef91-31a0-4a3e-a9aa-59122496eb76 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:56.325480 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8ff5ef91-31a0-4a3e-a9aa-59122496eb76 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:56.328003 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:47:56.459865 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-8ff5ef91-31a0-4a3e-a9aa-59122496eb76 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:56.467957 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-8ff5ef91-31a0-4a3e-a9aa-59122496eb76 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:56.469451 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-8ff5ef91-31a0-4a3e-a9aa-59122496eb76 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:56.470658 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-8ff5ef91-31a0-4a3e-a9aa-59122496eb76 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 200 len: 1727 microversion: 2.20 time: 0.158641 Aug 09 02:47:56.471242 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 492/953] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:47:56 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:47:57.493244 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-424123e3-2f3c-406a-967c-f32eea0781c5 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:57.493833 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-424123e3-2f3c-406a-967c-f32eea0781c5 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:47:57.500392 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-424123e3-2f3c-406a-967c-f32eea0781c5 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:57.500870 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-424123e3-2f3c-406a-967c-f32eea0781c5 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:57.501300 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-424123e3-2f3c-406a-967c-f32eea0781c5 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:57.501992 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-424123e3-2f3c-406a-967c-f32eea0781c5 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:57.502487 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-424123e3-2f3c-406a-967c-f32eea0781c5 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:57.502952 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-424123e3-2f3c-406a-967c-f32eea0781c5 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:57.633286 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-424123e3-2f3c-406a-967c-f32eea0781c5 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:57.642264 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-424123e3-2f3c-406a-967c-f32eea0781c5 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:57.643918 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-424123e3-2f3c-406a-967c-f32eea0781c5 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:57.645105 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-424123e3-2f3c-406a-967c-f32eea0781c5 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 200 len: 1727 microversion: 2.20 time: 0.156176 Aug 09 02:47:57.645669 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 462/954] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:47:57 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:47:58.668123 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-4fad8805-01d3-4050-8169-37356890b499 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:58.668730 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-4fad8805-01d3-4050-8169-37356890b499 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:47:58.675451 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4fad8805-01d3-4050-8169-37356890b499 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:58.676055 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4fad8805-01d3-4050-8169-37356890b499 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:58.676332 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4fad8805-01d3-4050-8169-37356890b499 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:58.677054 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4fad8805-01d3-4050-8169-37356890b499 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:58.677462 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4fad8805-01d3-4050-8169-37356890b499 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:58.677873 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4fad8805-01d3-4050-8169-37356890b499 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:58.815461 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-4fad8805-01d3-4050-8169-37356890b499 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:58.827039 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-4fad8805-01d3-4050-8169-37356890b499 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:58.828523 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-4fad8805-01d3-4050-8169-37356890b499 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:47:58.829678 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-4fad8805-01d3-4050-8169-37356890b499 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 200 len: 1727 microversion: 2.20 time: 0.165793 Aug 09 02:47:58.830249 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 493/955] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:47:58 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:47:59.852578 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-29abff44-bf37-48a3-a77c-0e822bc97e1e tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:47:59.853409 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-29abff44-bf37-48a3-a77c-0e822bc97e1e tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:47:59.859939 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-29abff44-bf37-48a3-a77c-0e822bc97e1e tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:59.860428 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-29abff44-bf37-48a3-a77c-0e822bc97e1e tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:59.860857 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-29abff44-bf37-48a3-a77c-0e822bc97e1e tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:47:59.861550 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-29abff44-bf37-48a3-a77c-0e822bc97e1e tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:47:59.861998 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-29abff44-bf37-48a3-a77c-0e822bc97e1e tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:47:59.862475 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-29abff44-bf37-48a3-a77c-0e822bc97e1e tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:00.009548 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-29abff44-bf37-48a3-a77c-0e822bc97e1e tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:48:00.017774 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-29abff44-bf37-48a3-a77c-0e822bc97e1e tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:48:00.019451 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-29abff44-bf37-48a3-a77c-0e822bc97e1e tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:48:00.020660 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-29abff44-bf37-48a3-a77c-0e822bc97e1e tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 200 len: 1727 microversion: 2.20 time: 0.172270 Aug 09 02:48:00.021296 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 463/956] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:47:59 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 1727 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:48:00.915942 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [req-3f05e8a5-ff10-4fa1-bb57-566cf5484598 req-7f69228b-a857-4ec9-a95f-f69e7357864f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01aef713-9cfa-4840-829f-b5d30b2f9549", "name": "network-vif-plugged", "status": "completed", "tag": "c771a4c1-387c-4632-a527-0af0b51cc089"}]} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:48:00.926481 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-3f05e8a5-ff10-4fa1-bb57-566cf5484598 req-7f69228b-a857-4ec9-a95f-f69e7357864f service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:00.926978 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-3f05e8a5-ff10-4fa1-bb57-566cf5484598 req-7f69228b-a857-4ec9-a95f-f69e7357864f service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:00.927396 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-3f05e8a5-ff10-4fa1-bb57-566cf5484598 req-7f69228b-a857-4ec9-a95f-f69e7357864f service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:00.940058 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.compute.server_external_events [req-3f05e8a5-ff10-4fa1-bb57-566cf5484598 req-7f69228b-a857-4ec9-a95f-f69e7357864f service nova] Creating event network-vif-plugged:c771a4c1-387c-4632-a527-0af0b51cc089 for instance 01aef713-9cfa-4840-829f-b5d30b2f9549 on hv-cinder-85246 Aug 09 02:48:00.945241 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [req-3f05e8a5-ff10-4fa1-bb57-566cf5484598 req-7f69228b-a857-4ec9-a95f-f69e7357864f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033010 Aug 09 02:48:00.945870 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 494/957] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:48:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:48:01.044521 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-b6a866e9-d643-4a52-9a48-f80609c2dc4c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:48:01.045063 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-b6a866e9-d643-4a52-9a48-f80609c2dc4c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:48:01.052484 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b6a866e9-d643-4a52-9a48-f80609c2dc4c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:01.052961 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b6a866e9-d643-4a52-9a48-f80609c2dc4c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:01.053385 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b6a866e9-d643-4a52-9a48-f80609c2dc4c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:01.054082 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b6a866e9-d643-4a52-9a48-f80609c2dc4c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:01.054551 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b6a866e9-d643-4a52-9a48-f80609c2dc4c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:01.054992 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b6a866e9-d643-4a52-9a48-f80609c2dc4c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:01.228435 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-b6a866e9-d643-4a52-9a48-f80609c2dc4c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:48:01.237557 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-b6a866e9-d643-4a52-9a48-f80609c2dc4c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:48:01.239775 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-b6a866e9-d643-4a52-9a48-f80609c2dc4c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:48:01.241288 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-b6a866e9-d643-4a52-9a48-f80609c2dc4c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 200 len: 1727 microversion: 2.20 time: 0.201410 Aug 09 02:48:01.257823 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 464/958] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:48:01 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 1727 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:48:02.270063 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-47e2d90f-9502-4719-9efb-7b2a07bf150f tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:48:02.270714 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-47e2d90f-9502-4719-9efb-7b2a07bf150f tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:48:02.277842 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-47e2d90f-9502-4719-9efb-7b2a07bf150f tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:02.278387 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-47e2d90f-9502-4719-9efb-7b2a07bf150f tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:02.278870 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-47e2d90f-9502-4719-9efb-7b2a07bf150f tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:02.279604 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-47e2d90f-9502-4719-9efb-7b2a07bf150f tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:02.280054 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-47e2d90f-9502-4719-9efb-7b2a07bf150f tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:02.280470 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-47e2d90f-9502-4719-9efb-7b2a07bf150f tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:02.416711 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-47e2d90f-9502-4719-9efb-7b2a07bf150f tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:48:02.427773 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-47e2d90f-9502-4719-9efb-7b2a07bf150f tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:48:02.429305 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-47e2d90f-9502-4719-9efb-7b2a07bf150f tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:48:02.430557 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-47e2d90f-9502-4719-9efb-7b2a07bf150f tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 200 len: 1727 microversion: 2.20 time: 0.168101 Aug 09 02:48:02.431117 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 495/959] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:48:02 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 1727 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:48:03.455460 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-e316b599-b0dc-48a8-8127-f8d29436377d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:48:03.456076 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-e316b599-b0dc-48a8-8127-f8d29436377d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:48:03.465756 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e316b599-b0dc-48a8-8127-f8d29436377d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:03.466472 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e316b599-b0dc-48a8-8127-f8d29436377d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:03.467028 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e316b599-b0dc-48a8-8127-f8d29436377d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:03.467784 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e316b599-b0dc-48a8-8127-f8d29436377d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:03.468356 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e316b599-b0dc-48a8-8127-f8d29436377d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:03.468794 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e316b599-b0dc-48a8-8127-f8d29436377d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:03.603825 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-e316b599-b0dc-48a8-8127-f8d29436377d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:48:03.612427 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-e316b599-b0dc-48a8-8127-f8d29436377d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:48:03.614361 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-e316b599-b0dc-48a8-8127-f8d29436377d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:48:03.615516 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-e316b599-b0dc-48a8-8127-f8d29436377d tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 200 len: 1727 microversion: 2.20 time: 0.166344 Aug 09 02:48:03.616088 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 465/960] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:48:03 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:48:04.639282 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-bda49113-bebc-4d69-8d85-1e6dc0994541 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:48:04.639831 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-bda49113-bebc-4d69-8d85-1e6dc0994541 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:48:04.646790 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-bda49113-bebc-4d69-8d85-1e6dc0994541 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:04.647270 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-bda49113-bebc-4d69-8d85-1e6dc0994541 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:04.647692 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-bda49113-bebc-4d69-8d85-1e6dc0994541 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:04.648371 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-bda49113-bebc-4d69-8d85-1e6dc0994541 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:04.648813 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-bda49113-bebc-4d69-8d85-1e6dc0994541 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:04.649227 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-bda49113-bebc-4d69-8d85-1e6dc0994541 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:04.796484 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-bda49113-bebc-4d69-8d85-1e6dc0994541 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:48:04.806278 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-bda49113-bebc-4d69-8d85-1e6dc0994541 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:48:04.808161 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-bda49113-bebc-4d69-8d85-1e6dc0994541 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:48:04.809326 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-bda49113-bebc-4d69-8d85-1e6dc0994541 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 200 len: 1727 microversion: 2.20 time: 0.174190 Aug 09 02:48:04.809886 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 496/961] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:48:04 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 1727 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:48:05.832705 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-2c69682c-41d1-42d2-8e44-1cffffe74be7 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:48:05.833440 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-2c69682c-41d1-42d2-8e44-1cffffe74be7 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:48:05.840230 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2c69682c-41d1-42d2-8e44-1cffffe74be7 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:05.840711 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2c69682c-41d1-42d2-8e44-1cffffe74be7 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:05.841143 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2c69682c-41d1-42d2-8e44-1cffffe74be7 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:05.841907 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2c69682c-41d1-42d2-8e44-1cffffe74be7 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:05.842303 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2c69682c-41d1-42d2-8e44-1cffffe74be7 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:05.842870 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2c69682c-41d1-42d2-8e44-1cffffe74be7 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:06.001689 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-2c69682c-41d1-42d2-8e44-1cffffe74be7 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:48:06.009898 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-2c69682c-41d1-42d2-8e44-1cffffe74be7 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:48:06.011499 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-2c69682c-41d1-42d2-8e44-1cffffe74be7 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:48:06.012736 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-2c69682c-41d1-42d2-8e44-1cffffe74be7 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 200 len: 1727 microversion: 2.20 time: 0.184567 Aug 09 02:48:06.013371 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 466/962] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:48:05 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 1727 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:48:07.039784 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-1679d314-a618-4635-9800-9c32dab142ef tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:48:07.040466 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-1679d314-a618-4635-9800-9c32dab142ef tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:48:07.048160 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1679d314-a618-4635-9800-9c32dab142ef tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:07.048757 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1679d314-a618-4635-9800-9c32dab142ef tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:07.049296 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1679d314-a618-4635-9800-9c32dab142ef tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:07.050267 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1679d314-a618-4635-9800-9c32dab142ef tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:07.050747 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1679d314-a618-4635-9800-9c32dab142ef tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:07.051276 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1679d314-a618-4635-9800-9c32dab142ef tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:07.195756 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-1679d314-a618-4635-9800-9c32dab142ef tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:48:07.203883 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-1679d314-a618-4635-9800-9c32dab142ef tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:48:07.205378 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-1679d314-a618-4635-9800-9c32dab142ef tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:48:07.206580 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-1679d314-a618-4635-9800-9c32dab142ef tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 200 len: 1727 microversion: 2.20 time: 0.173402 Aug 09 02:48:07.207149 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 497/963] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:48:07 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 1727 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:48:08.233815 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-b370746b-6c6b-45e6-b1e2-554ca66d65b9 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:48:08.234825 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-b370746b-6c6b-45e6-b1e2-554ca66d65b9 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:48:08.244212 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b370746b-6c6b-45e6-b1e2-554ca66d65b9 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:08.244692 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b370746b-6c6b-45e6-b1e2-554ca66d65b9 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:08.245129 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b370746b-6c6b-45e6-b1e2-554ca66d65b9 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:08.245821 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b370746b-6c6b-45e6-b1e2-554ca66d65b9 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:08.246312 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b370746b-6c6b-45e6-b1e2-554ca66d65b9 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:08.246739 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b370746b-6c6b-45e6-b1e2-554ca66d65b9 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:08.385571 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-b370746b-6c6b-45e6-b1e2-554ca66d65b9 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:48:08.393925 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-b370746b-6c6b-45e6-b1e2-554ca66d65b9 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:48:08.395473 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-b370746b-6c6b-45e6-b1e2-554ca66d65b9 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:48:08.396641 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-b370746b-6c6b-45e6-b1e2-554ca66d65b9 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 200 len: 1727 microversion: 2.20 time: 0.169532 Aug 09 02:48:08.397397 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 467/964] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:48:08 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 1727 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:48:09.422753 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-33f8640d-973d-4049-86f6-211350fae4c3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:48:09.423220 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-33f8640d-973d-4049-86f6-211350fae4c3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:48:09.425938 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_api:SELECT=26 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:48:09.432744 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-33f8640d-973d-4049-86f6-211350fae4c3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:09.433346 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-33f8640d-973d-4049-86f6-211350fae4c3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:09.433883 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-33f8640d-973d-4049-86f6-211350fae4c3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:09.434769 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-33f8640d-973d-4049-86f6-211350fae4c3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:09.435353 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-33f8640d-973d-4049-86f6-211350fae4c3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:09.435850 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-33f8640d-973d-4049-86f6-211350fae4c3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:09.567758 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-33f8640d-973d-4049-86f6-211350fae4c3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:48:09.576303 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-33f8640d-973d-4049-86f6-211350fae4c3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:48:09.577808 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-33f8640d-973d-4049-86f6-211350fae4c3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:48:09.579086 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-33f8640d-973d-4049-86f6-211350fae4c3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 200 len: 1714 microversion: 2.20 time: 0.162034 Aug 09 02:48:09.579632 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 498/965] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:48:09 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 1714 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:48:20.525329 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-e15bcfaa-c26c-4a2d-aae8-a53671439695 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-332400601", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-93674777", "security_groups": [{"name": "tempest-secgroup-smoke-1734634472"}], "block_device_mapping_v2": [{"uuid": "065244af-a0ac-4281-b769-6cc0593ef4c5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b1e2d894-011a-4b96-b401-d6a3370e9f10"}]}} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:48:20.535029 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_api:SELECT=17 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:48:20.535677 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_cell1:SELECT=73 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:48:20.654426 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.network.neutron [None req-e15bcfaa-c26c-4a2d-aae8-a53671439695 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] validate_networks() for [('b1e2d894-011a-4b96-b401-d6a3370e9f10', None, None, None, None, None)] {{(pid=124425) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 02:48:21.035773 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.virt.hardware [None req-e15bcfaa-c26c-4a2d-aae8-a53671439695 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Flavor limits 0:0:0 {{(pid=124425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 02:48:21.036393 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.virt.hardware [None req-e15bcfaa-c26c-4a2d-aae8-a53671439695 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Image limits 0:0:0 {{(pid=124425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 02:48:21.036998 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.virt.hardware [None req-e15bcfaa-c26c-4a2d-aae8-a53671439695 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Flavor pref 0:0:0 {{(pid=124425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 02:48:21.037543 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.virt.hardware [None req-e15bcfaa-c26c-4a2d-aae8-a53671439695 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Image pref 0:0:0 {{(pid=124425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 02:48:21.038107 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.virt.hardware [None req-e15bcfaa-c26c-4a2d-aae8-a53671439695 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 02:48:21.048665 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e15bcfaa-c26c-4a2d-aae8-a53671439695 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:21.049149 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e15bcfaa-c26c-4a2d-aae8-a53671439695 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:21.049594 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e15bcfaa-c26c-4a2d-aae8-a53671439695 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:21.050335 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e15bcfaa-c26c-4a2d-aae8-a53671439695 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:21.050788 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e15bcfaa-c26c-4a2d-aae8-a53671439695 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:21.051211 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e15bcfaa-c26c-4a2d-aae8-a53671439695 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:21.068399 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.quota [None req-e15bcfaa-c26c-4a2d-aae8-a53671439695 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Getting quotas for project 9aadaf242f674436a45eae700fb52fc1. Resources: {'cores', 'ram', 'instances'} {{(pid=124425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 02:48:21.072510 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.quota [None req-e15bcfaa-c26c-4a2d-aae8-a53671439695 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Getting quotas for user 90fa94f90d49485a81d502929bcd0b93 and project 9aadaf242f674436a45eae700fb52fc1. Resources: {'cores', 'ram', 'instances'} {{(pid=124425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 02:48:21.132422 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-e15bcfaa-c26c-4a2d-aae8-a53671439695 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Going to run 1 instances... {{(pid=124425) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 02:48:21.135643 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-e15bcfaa-c26c-4a2d-aae8-a53671439695 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 088a9dcc-2c63-4ce0-803a-24abd76c0957] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='065244af-a0ac-4281-b769-6cc0593ef4c5',volume_size=None,volume_type=None)] {{(pid=124425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 02:48:21.275286 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-e15bcfaa-c26c-4a2d-aae8-a53671439695 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.753970 Aug 09 02:48:21.276384 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 468/966] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Aug 9 02:48:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 02:48:21.287727 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-69b87bc2-3fd3-4e5d-a305-61dfc1767198 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:48:21.288274 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-69b87bc2-3fd3-4e5d-a305-61dfc1767198 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 088a9dcc-2c63-4ce0-803a-24abd76c0957] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:48:21.290768 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_api:SELECT=1 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:48:21.291409 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_cell1:SELECT=37 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:48:21.360084 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-69b87bc2-3fd3-4e5d-a305-61dfc1767198 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:48:21.367414 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-69b87bc2-3fd3-4e5d-a305-61dfc1767198 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/088a9dcc-2c63-4ce0-803a-24abd76c0957" status: 200 len: 1092 microversion: 2.1 time: 0.083650 Aug 09 02:48:21.368508 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 499/967] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:48:21 2022] GET /compute/v2.1/servers/088a9dcc-2c63-4ce0-803a-24abd76c0957 => generated 1092 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:48:22.389754 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-7207d9d4-6803-441e-8894-07d1b0a872b9 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:48:22.390612 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-7207d9d4-6803-441e-8894-07d1b0a872b9 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 088a9dcc-2c63-4ce0-803a-24abd76c0957] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:48:22.397500 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7207d9d4-6803-441e-8894-07d1b0a872b9 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:22.398108 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7207d9d4-6803-441e-8894-07d1b0a872b9 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:22.398820 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7207d9d4-6803-441e-8894-07d1b0a872b9 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:22.399867 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7207d9d4-6803-441e-8894-07d1b0a872b9 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:22.401226 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7207d9d4-6803-441e-8894-07d1b0a872b9 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:22.401803 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7207d9d4-6803-441e-8894-07d1b0a872b9 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:22.486302 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-7207d9d4-6803-441e-8894-07d1b0a872b9 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:48:22.497256 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-7207d9d4-6803-441e-8894-07d1b0a872b9 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/088a9dcc-2c63-4ce0-803a-24abd76c0957" status: 200 len: 1198 microversion: 2.1 time: 0.112020 Aug 09 02:48:22.498010 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 469/968] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:48:22 2022] GET /compute/v2.1/servers/088a9dcc-2c63-4ce0-803a-24abd76c0957 => generated 1198 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:48:23.520163 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-409b9bc8-1c76-4e58-9bc9-36ebddf02e2c tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:48:23.520839 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-409b9bc8-1c76-4e58-9bc9-36ebddf02e2c tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 088a9dcc-2c63-4ce0-803a-24abd76c0957] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:48:23.527930 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-409b9bc8-1c76-4e58-9bc9-36ebddf02e2c tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:23.528897 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-409b9bc8-1c76-4e58-9bc9-36ebddf02e2c tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:23.529697 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-409b9bc8-1c76-4e58-9bc9-36ebddf02e2c tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:23.530740 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-409b9bc8-1c76-4e58-9bc9-36ebddf02e2c tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:23.531364 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-409b9bc8-1c76-4e58-9bc9-36ebddf02e2c tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:23.532342 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-409b9bc8-1c76-4e58-9bc9-36ebddf02e2c tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:23.683559 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-409b9bc8-1c76-4e58-9bc9-36ebddf02e2c tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:48:23.691134 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-409b9bc8-1c76-4e58-9bc9-36ebddf02e2c tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/088a9dcc-2c63-4ce0-803a-24abd76c0957" status: 200 len: 1264 microversion: 2.1 time: 0.175028 Aug 09 02:48:23.692187 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 500/969] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:48:23 2022] GET /compute/v2.1/servers/088a9dcc-2c63-4ce0-803a-24abd76c0957 => generated 1264 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:48:24.047303 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [req-dcb0f7a6-539c-407f-8289-1f626cb25e3e req-b277d012-470b-42d6-a57e-357c25c07ca5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "088a9dcc-2c63-4ce0-803a-24abd76c0957", "tag": "83f25e4f-a0a2-405d-90b0-5f49d4471e1e"}]} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:48:24.058061 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-dcb0f7a6-539c-407f-8289-1f626cb25e3e req-b277d012-470b-42d6-a57e-357c25c07ca5 service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:24.058802 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-dcb0f7a6-539c-407f-8289-1f626cb25e3e req-b277d012-470b-42d6-a57e-357c25c07ca5 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:24.059287 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-dcb0f7a6-539c-407f-8289-1f626cb25e3e req-b277d012-470b-42d6-a57e-357c25c07ca5 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:24.071175 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.compute.server_external_events [req-dcb0f7a6-539c-407f-8289-1f626cb25e3e req-b277d012-470b-42d6-a57e-357c25c07ca5 service nova] Creating event network-changed:83f25e4f-a0a2-405d-90b0-5f49d4471e1e for instance 088a9dcc-2c63-4ce0-803a-24abd76c0957 on hv-cinder-85246 Aug 09 02:48:24.076790 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [req-dcb0f7a6-539c-407f-8289-1f626cb25e3e req-b277d012-470b-42d6-a57e-357c25c07ca5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033363 Aug 09 02:48:24.077530 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 470/970] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:48:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:48:24.712367 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-89433266-4b8c-444f-bec7-425abe2fc5b0 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:48:24.712990 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-89433266-4b8c-444f-bec7-425abe2fc5b0 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 088a9dcc-2c63-4ce0-803a-24abd76c0957] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:48:24.719968 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-89433266-4b8c-444f-bec7-425abe2fc5b0 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:24.720528 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-89433266-4b8c-444f-bec7-425abe2fc5b0 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:24.720990 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-89433266-4b8c-444f-bec7-425abe2fc5b0 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:24.721718 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-89433266-4b8c-444f-bec7-425abe2fc5b0 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:24.722187 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-89433266-4b8c-444f-bec7-425abe2fc5b0 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:24.722664 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-89433266-4b8c-444f-bec7-425abe2fc5b0 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:24.871851 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-89433266-4b8c-444f-bec7-425abe2fc5b0 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:48:24.881364 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-89433266-4b8c-444f-bec7-425abe2fc5b0 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/088a9dcc-2c63-4ce0-803a-24abd76c0957" status: 200 len: 1264 microversion: 2.1 time: 0.172871 Aug 09 02:48:24.882535 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 501/971] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:48:24 2022] GET /compute/v2.1/servers/088a9dcc-2c63-4ce0-803a-24abd76c0957 => generated 1264 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:48:25.904323 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-ede41a8e-0dcb-4302-8020-cf5633998622 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:48:25.905069 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-ede41a8e-0dcb-4302-8020-cf5633998622 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 088a9dcc-2c63-4ce0-803a-24abd76c0957] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:48:25.912072 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ede41a8e-0dcb-4302-8020-cf5633998622 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:25.912585 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ede41a8e-0dcb-4302-8020-cf5633998622 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:25.913008 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ede41a8e-0dcb-4302-8020-cf5633998622 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:25.913752 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ede41a8e-0dcb-4302-8020-cf5633998622 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:25.914300 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ede41a8e-0dcb-4302-8020-cf5633998622 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:25.914767 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ede41a8e-0dcb-4302-8020-cf5633998622 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:26.057165 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-ede41a8e-0dcb-4302-8020-cf5633998622 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:48:26.065205 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-ede41a8e-0dcb-4302-8020-cf5633998622 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/088a9dcc-2c63-4ce0-803a-24abd76c0957" status: 200 len: 1264 microversion: 2.1 time: 0.166176 Aug 09 02:48:26.065780 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 471/972] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:48:25 2022] GET /compute/v2.1/servers/088a9dcc-2c63-4ce0-803a-24abd76c0957 => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:48:26.245667 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [req-55f6cda2-15da-4080-8bb2-b980a92fbd73 req-0e3ebba1-c104-44fa-a9d1-ecc3fcfb72a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b", "tag": "f12d9ad9-133b-4098-a94d-fd5f540a9f7c"}]} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:48:26.247726 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-4f679c40-725b-407b-a9ab-7b2074e7ad7c tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:48:26.248257 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-4f679c40-725b-407b-a9ab-7b2074e7ad7c tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] [instance: 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:48:26.257601 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4f679c40-725b-407b-a9ab-7b2074e7ad7c tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:26.257939 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-55f6cda2-15da-4080-8bb2-b980a92fbd73 req-0e3ebba1-c104-44fa-a9d1-ecc3fcfb72a0 service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:26.258079 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4f679c40-725b-407b-a9ab-7b2074e7ad7c tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:26.258442 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-55f6cda2-15da-4080-8bb2-b980a92fbd73 req-0e3ebba1-c104-44fa-a9d1-ecc3fcfb72a0 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:26.258565 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4f679c40-725b-407b-a9ab-7b2074e7ad7c tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:26.258858 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-55f6cda2-15da-4080-8bb2-b980a92fbd73 req-0e3ebba1-c104-44fa-a9d1-ecc3fcfb72a0 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:26.259186 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4f679c40-725b-407b-a9ab-7b2074e7ad7c tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:26.259630 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4f679c40-725b-407b-a9ab-7b2074e7ad7c tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:26.260041 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4f679c40-725b-407b-a9ab-7b2074e7ad7c tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:26.288075 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.compute.server_external_events [req-55f6cda2-15da-4080-8bb2-b980a92fbd73 req-0e3ebba1-c104-44fa-a9d1-ecc3fcfb72a0 service nova] Creating event network-changed:f12d9ad9-133b-4098-a94d-fd5f540a9f7c for instance 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b on hv-cinder-85246 Aug 09 02:48:26.288382 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-4f679c40-725b-407b-a9ab-7b2074e7ad7c tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] [instance: 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b] Going to try to terminate instance {{(pid=124427) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 02:48:26.296169 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [req-55f6cda2-15da-4080-8bb2-b980a92fbd73 req-0e3ebba1-c104-44fa-a9d1-ecc3fcfb72a0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053893 Aug 09 02:48:26.301185 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 472/973] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:48:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:48:26.404693 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-4f679c40-725b-407b-a9ab-7b2074e7ad7c tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b" status: 204 len: 0 microversion: 2.1 time: 0.161738 Aug 09 02:48:26.406591 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 502/974] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 9 02:48:26 2022] DELETE /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 02:48:26.416426 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-ed6a89a8-6de7-47a9-98d2-a9dc08f39359 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:48:26.417162 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-ed6a89a8-6de7-47a9-98d2-a9dc08f39359 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] [instance: 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:48:26.423585 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ed6a89a8-6de7-47a9-98d2-a9dc08f39359 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:26.424215 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ed6a89a8-6de7-47a9-98d2-a9dc08f39359 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:26.424642 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ed6a89a8-6de7-47a9-98d2-a9dc08f39359 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:26.425527 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ed6a89a8-6de7-47a9-98d2-a9dc08f39359 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:26.425984 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ed6a89a8-6de7-47a9-98d2-a9dc08f39359 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:26.426435 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ed6a89a8-6de7-47a9-98d2-a9dc08f39359 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:26.578448 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-ed6a89a8-6de7-47a9-98d2-a9dc08f39359 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96475caac28419eb0b7dd78375e9e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5d24d2b8dc4844a48a76ed2ea2cffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:48:26.589123 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-ed6a89a8-6de7-47a9-98d2-a9dc08f39359 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] 10.222.0.20 "GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b" status: 200 len: 1567 microversion: 2.1 time: 0.176849 Aug 09 02:48:26.590199 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 473/975] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:48:26 2022] GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:48:27.087022 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-b43c1425-da23-4ff5-be28-96aac980c72a tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:48:27.087818 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-b43c1425-da23-4ff5-be28-96aac980c72a tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 088a9dcc-2c63-4ce0-803a-24abd76c0957] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:48:27.094925 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b43c1425-da23-4ff5-be28-96aac980c72a tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:27.095671 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b43c1425-da23-4ff5-be28-96aac980c72a tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:27.096108 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b43c1425-da23-4ff5-be28-96aac980c72a tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:27.096841 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b43c1425-da23-4ff5-be28-96aac980c72a tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:27.097285 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b43c1425-da23-4ff5-be28-96aac980c72a tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:27.097694 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b43c1425-da23-4ff5-be28-96aac980c72a tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:27.252006 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-b43c1425-da23-4ff5-be28-96aac980c72a tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:48:27.260177 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-b43c1425-da23-4ff5-be28-96aac980c72a tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/088a9dcc-2c63-4ce0-803a-24abd76c0957" status: 200 len: 1264 microversion: 2.1 time: 0.177333 Aug 09 02:48:27.261219 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 503/976] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:48:27 2022] GET /compute/v2.1/servers/088a9dcc-2c63-4ce0-803a-24abd76c0957 => generated 1264 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:48:27.610719 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-bac1a848-1ccf-45bb-be57-7e3d8e062271 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:48:27.611414 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-bac1a848-1ccf-45bb-be57-7e3d8e062271 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] [instance: 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:48:27.618378 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-bac1a848-1ccf-45bb-be57-7e3d8e062271 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:27.618863 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-bac1a848-1ccf-45bb-be57-7e3d8e062271 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:27.619298 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-bac1a848-1ccf-45bb-be57-7e3d8e062271 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:27.619989 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-bac1a848-1ccf-45bb-be57-7e3d8e062271 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:27.620467 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-bac1a848-1ccf-45bb-be57-7e3d8e062271 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:27.620886 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-bac1a848-1ccf-45bb-be57-7e3d8e062271 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:27.755222 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-bac1a848-1ccf-45bb-be57-7e3d8e062271 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96475caac28419eb0b7dd78375e9e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5d24d2b8dc4844a48a76ed2ea2cffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:48:27.762800 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-bac1a848-1ccf-45bb-be57-7e3d8e062271 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] 10.222.0.20 "GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b" status: 200 len: 1567 microversion: 2.1 time: 0.156116 Aug 09 02:48:27.763368 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 474/977] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:48:27 2022] GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:48:28.283143 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-553a4663-551e-465a-97c2-c769c9b9264c tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:48:28.283740 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-553a4663-551e-465a-97c2-c769c9b9264c tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 088a9dcc-2c63-4ce0-803a-24abd76c0957] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:48:28.291383 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-553a4663-551e-465a-97c2-c769c9b9264c tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:28.292011 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-553a4663-551e-465a-97c2-c769c9b9264c tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:28.292578 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-553a4663-551e-465a-97c2-c769c9b9264c tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:28.293396 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-553a4663-551e-465a-97c2-c769c9b9264c tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:28.293851 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-553a4663-551e-465a-97c2-c769c9b9264c tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:28.294293 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-553a4663-551e-465a-97c2-c769c9b9264c tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:28.540033 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-553a4663-551e-465a-97c2-c769c9b9264c tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:48:28.548189 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-553a4663-551e-465a-97c2-c769c9b9264c tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/088a9dcc-2c63-4ce0-803a-24abd76c0957" status: 200 len: 1264 microversion: 2.1 time: 0.270655 Aug 09 02:48:28.548775 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 504/978] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:48:28 2022] GET /compute/v2.1/servers/088a9dcc-2c63-4ce0-803a-24abd76c0957 => generated 1264 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:48:28.786045 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-33268515-e5c0-4c9d-a20b-79b09db3df75 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:48:28.786706 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-33268515-e5c0-4c9d-a20b-79b09db3df75 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] [instance: 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:48:28.793535 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-33268515-e5c0-4c9d-a20b-79b09db3df75 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:28.794019 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-33268515-e5c0-4c9d-a20b-79b09db3df75 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:28.794472 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-33268515-e5c0-4c9d-a20b-79b09db3df75 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:28.795175 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-33268515-e5c0-4c9d-a20b-79b09db3df75 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:28.795619 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-33268515-e5c0-4c9d-a20b-79b09db3df75 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:28.796036 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-33268515-e5c0-4c9d-a20b-79b09db3df75 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:28.906874 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-33268515-e5c0-4c9d-a20b-79b09db3df75 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96475caac28419eb0b7dd78375e9e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5d24d2b8dc4844a48a76ed2ea2cffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:48:28.909573 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [req-cc35a297-633e-48e4-bc85-5442faf95aa5 req-5911e1b3-b637-4c49-8f66-70b0ab0fc5ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b", "name": "network-vif-deleted", "tag": "f12d9ad9-133b-4098-a94d-fd5f540a9f7c"}]} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:48:28.915065 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-33268515-e5c0-4c9d-a20b-79b09db3df75 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] 10.222.0.20 "GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b" status: 200 len: 1381 microversion: 2.1 time: 0.133278 Aug 09 02:48:28.916089 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 475/979] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:48:28 2022] GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b => generated 1381 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:48:28.922349 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-cc35a297-633e-48e4-bc85-5442faf95aa5 req-5911e1b3-b637-4c49-8f66-70b0ab0fc5ee service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:28.923050 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-cc35a297-633e-48e4-bc85-5442faf95aa5 req-5911e1b3-b637-4c49-8f66-70b0ab0fc5ee service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:28.923681 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-cc35a297-633e-48e4-bc85-5442faf95aa5 req-5911e1b3-b637-4c49-8f66-70b0ab0fc5ee service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:28.936176 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.compute.server_external_events [req-cc35a297-633e-48e4-bc85-5442faf95aa5 req-5911e1b3-b637-4c49-8f66-70b0ab0fc5ee service nova] Creating event network-vif-deleted:f12d9ad9-133b-4098-a94d-fd5f540a9f7c for instance 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b on hv-cinder-85246 Aug 09 02:48:28.941068 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [req-cc35a297-633e-48e4-bc85-5442faf95aa5 req-5911e1b3-b637-4c49-8f66-70b0ab0fc5ee service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035355 Aug 09 02:48:28.941658 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 505/980] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:48:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 02:48:29.573927 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-e5c94475-c04e-43ae-bbc6-8c026dbb6b45 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:48:29.574901 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-e5c94475-c04e-43ae-bbc6-8c026dbb6b45 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 088a9dcc-2c63-4ce0-803a-24abd76c0957] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:48:29.584894 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e5c94475-c04e-43ae-bbc6-8c026dbb6b45 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:29.585701 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e5c94475-c04e-43ae-bbc6-8c026dbb6b45 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:29.586484 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e5c94475-c04e-43ae-bbc6-8c026dbb6b45 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:29.587621 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e5c94475-c04e-43ae-bbc6-8c026dbb6b45 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:29.588369 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e5c94475-c04e-43ae-bbc6-8c026dbb6b45 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:29.589074 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e5c94475-c04e-43ae-bbc6-8c026dbb6b45 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:29.730250 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-e5c94475-c04e-43ae-bbc6-8c026dbb6b45 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:48:29.745285 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-e5c94475-c04e-43ae-bbc6-8c026dbb6b45 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/088a9dcc-2c63-4ce0-803a-24abd76c0957" status: 200 len: 1264 microversion: 2.1 time: 0.178219 Aug 09 02:48:29.745938 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 476/981] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:48:29 2022] GET /compute/v2.1/servers/088a9dcc-2c63-4ce0-803a-24abd76c0957 => generated 1264 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:48:29.939576 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-64f69436-31aa-4f7b-9ca8-a6f687bead84 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:48:29.940269 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-64f69436-31aa-4f7b-9ca8-a6f687bead84 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] [instance: 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:48:29.946825 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-64f69436-31aa-4f7b-9ca8-a6f687bead84 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:29.947300 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-64f69436-31aa-4f7b-9ca8-a6f687bead84 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:29.947729 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-64f69436-31aa-4f7b-9ca8-a6f687bead84 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:29.948405 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-64f69436-31aa-4f7b-9ca8-a6f687bead84 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:29.948849 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-64f69436-31aa-4f7b-9ca8-a6f687bead84 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:29.949263 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-64f69436-31aa-4f7b-9ca8-a6f687bead84 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:29.980409 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-64f69436-31aa-4f7b-9ca8-a6f687bead84 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:29.980873 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-64f69436-31aa-4f7b-9ca8-a6f687bead84 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:29.981294 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-64f69436-31aa-4f7b-9ca8-a6f687bead84 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:29.981725 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.objects.instance [None req-64f69436-31aa-4f7b-9ca8-a6f687bead84 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lazy-loading 'fault' on Instance uuid 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b {{(pid=124427) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 02:48:30.025015 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-64f69436-31aa-4f7b-9ca8-a6f687bead84 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96475caac28419eb0b7dd78375e9e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5d24d2b8dc4844a48a76ed2ea2cffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:48:30.033971 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-64f69436-31aa-4f7b-9ca8-a6f687bead84 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] 10.222.0.20 "GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b" status: 200 len: 1224 microversion: 2.1 time: 0.098959 Aug 09 02:48:30.034564 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 506/982] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:48:29 2022] GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b => generated 1224 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:48:30.771347 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-72fa7f9c-7002-44f1-9c25-4f5caa117807 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:48:30.771933 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-72fa7f9c-7002-44f1-9c25-4f5caa117807 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 088a9dcc-2c63-4ce0-803a-24abd76c0957] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:48:30.778911 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-72fa7f9c-7002-44f1-9c25-4f5caa117807 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:30.779404 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-72fa7f9c-7002-44f1-9c25-4f5caa117807 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:30.779843 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-72fa7f9c-7002-44f1-9c25-4f5caa117807 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:30.780536 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-72fa7f9c-7002-44f1-9c25-4f5caa117807 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:30.780992 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-72fa7f9c-7002-44f1-9c25-4f5caa117807 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:30.781748 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-72fa7f9c-7002-44f1-9c25-4f5caa117807 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:30.930805 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-72fa7f9c-7002-44f1-9c25-4f5caa117807 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:48:30.938769 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-72fa7f9c-7002-44f1-9c25-4f5caa117807 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/088a9dcc-2c63-4ce0-803a-24abd76c0957" status: 200 len: 1264 microversion: 2.1 time: 0.171713 Aug 09 02:48:30.939342 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 477/983] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:48:30 2022] GET /compute/v2.1/servers/088a9dcc-2c63-4ce0-803a-24abd76c0957 => generated 1264 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:48:31.059932 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-1a463010-a4dd-445a-afd4-404bc6f6b882 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:48:31.060659 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-1a463010-a4dd-445a-afd4-404bc6f6b882 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] [instance: 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:48:31.067466 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1a463010-a4dd-445a-afd4-404bc6f6b882 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:31.067954 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1a463010-a4dd-445a-afd4-404bc6f6b882 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:31.068385 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1a463010-a4dd-445a-afd4-404bc6f6b882 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:31.069094 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1a463010-a4dd-445a-afd4-404bc6f6b882 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:31.069552 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1a463010-a4dd-445a-afd4-404bc6f6b882 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:31.069964 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1a463010-a4dd-445a-afd4-404bc6f6b882 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:31.084946 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.wsgi [None req-1a463010-a4dd-445a-afd4-404bc6f6b882 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] HTTP exception thrown: Instance 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b could not be found. Aug 09 02:48:31.086645 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-1a463010-a4dd-445a-afd4-404bc6f6b882 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Request method failure captured: Aug 09 02:48:31.086645 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: request: GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b HTTP/1.1 Aug 09 02:48:31.086645 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Accept: application/json Aug 09 02:48:31.086645 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Accept-Encoding: identity Aug 09 02:48:31.086645 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Connection: close Aug 09 02:48:31.086645 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Content-Length: 0 Aug 09 02:48:31.086645 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Content-Type: application/json Aug 09 02:48:31.086645 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Host: 10.222.0.20 Aug 09 02:48:31.086645 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Openstack-System-Scope: None Aug 09 02:48:31.086645 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: User-Agent: python-urllib3/1.26.11 Aug 09 02:48:31.086645 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Auth-Token: gAAAAABi8cm8GZQ544piKLE7ruc8JdE1AKzKkJ2fz8mTyspqBGYT1PyPAyZDOsZylHb5JqccRajz_W9Z4N8k-3Oo2_6G9FrkYZNqpm8hMHbpV0nD6cK0RCyfI6dh_hONsPMh5J4cm9rTL5ntmkWdr9zf7_m3BrsiAauFM7RdPqH60bDi8kTCegI Aug 09 02:48:31.086645 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Domain-Id: None Aug 09 02:48:31.086645 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Domain-Name: None Aug 09 02:48:31.086645 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Identity-Status: Confirmed Aug 09 02:48:31.086645 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Is-Admin-Project: True Aug 09 02:48:31.086645 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Domain-Id: default Aug 09 02:48:31.086645 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Domain-Name: Default Aug 09 02:48:31.086645 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Id: 2c5d24d2b8dc4844a48a76ed2ea2cffe Aug 09 02:48:31.086645 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Name: tempest-TestShelveInstance-11735074 Aug 09 02:48:31.086645 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Role: reader,member Aug 09 02:48:31.086645 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Roles: reader,member Aug 09 02:48:31.088359 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c5d24d2b8dc4844a48a76ed2ea2cffe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c5d24d2b8dc4844a48a76ed2ea2cffe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c5d24d2b8dc4844a48a76ed2ea2cffe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c5d24d2b8dc4844a48a76ed2ea2cffe"}]}] Aug 09 02:48:31.088359 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant: tempest-TestShelveInstance-11735074 Aug 09 02:48:31.088359 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant-Id: 2c5d24d2b8dc4844a48a76ed2ea2cffe Aug 09 02:48:31.088359 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant-Name: tempest-TestShelveInstance-11735074 Aug 09 02:48:31.088359 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User: tempest-TestShelveInstance-11735074-project Aug 09 02:48:31.088359 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Domain-Id: default Aug 09 02:48:31.088359 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Domain-Name: Default Aug 09 02:48:31.088359 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Id: f96475caac28419eb0b7dd78375e9e52 Aug 09 02:48:31.088359 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Name: tempest-TestShelveInstance-11735074-project Aug 09 02:48:31.088359 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: method: > Aug 09 02:48:31.088359 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: exception: Instance 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b could not be found. Aug 09 02:48:31.088359 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: action_args: {'id': '5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b'} Aug 09 02:48:31.089290 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 02:48:31.089290 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:48:31.089290 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 02:48:31.089290 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 02:48:31.089290 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 02:48:31.089290 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 02:48:31.089290 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 02:48:31.089290 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 02:48:31.089290 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 02:48:31.089290 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 02:48:31.089290 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b could not be found. Aug 09 02:48:31.089290 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:48:31.089290 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:48:31.089290 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:48:31.089290 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:48:31.089290 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:48:31.089290 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:48:31.089290 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 02:48:31.089290 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 02:48:31.089290 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 02:48:31.090898 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 02:48:31.090898 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 02:48:31.090898 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 02:48:31.090898 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 02:48:31.090898 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 02:48:31.090898 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 02:48:31.090898 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 02:48:31.090898 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b could not be found. Aug 09 02:48:31.090898 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:48:31.090898 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:48:31.090898 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:48:31.090898 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:48:31.090898 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:48:31.090898 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:48:31.090898 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 02:48:31.090898 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 02:48:31.090898 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b could not be found. Aug 09 02:48:31.090898 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:48:31.092330 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-1a463010-a4dd-445a-afd4-404bc6f6b882 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Returning 404 to user: Instance 5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b could not be found. {{(pid=124427) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 02:48:31.092330 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-1a463010-a4dd-445a-afd4-404bc6f6b882 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] 10.222.0.20 "GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b" status: 404 len: 111 microversion: 2.1 time: 0.034285 Aug 09 02:48:31.092330 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 507/984] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:48:31 2022] GET /compute/v2.1/servers/5fbf5370-c8a4-4cb3-9ffb-3895454c8c5b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 02:48:31.255757 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-5200d85e-933a-424b-b92c-c41b3253f900 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] Calling method '.version_select at 0x7fb0a0493a60>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:48:31.260903 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5200d85e-933a-424b-b92c-c41b3253f900 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] [f8b25369-d8db-49a1-8d8d-44915e3adfe9] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 09 02:48:31.261660 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_cell0:SELECT=2 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:48:31.263187 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_cell0:SELECT=6 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:48:31.956953 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_cell0:SELECT=2 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:48:31.961060 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-28beb89f-a92a-4ff5-ba03-68991b269d38 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:48:31.961669 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-28beb89f-a92a-4ff5-ba03-68991b269d38 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 088a9dcc-2c63-4ce0-803a-24abd76c0957] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:48:31.968079 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-28beb89f-a92a-4ff5-ba03-68991b269d38 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:31.968777 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-28beb89f-a92a-4ff5-ba03-68991b269d38 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:31.971644 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-28beb89f-a92a-4ff5-ba03-68991b269d38 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:31.972390 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-28beb89f-a92a-4ff5-ba03-68991b269d38 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:31.972930 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-28beb89f-a92a-4ff5-ba03-68991b269d38 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:31.975476 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-28beb89f-a92a-4ff5-ba03-68991b269d38 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:32.124359 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-28beb89f-a92a-4ff5-ba03-68991b269d38 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:48:32.135533 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-28beb89f-a92a-4ff5-ba03-68991b269d38 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/088a9dcc-2c63-4ce0-803a-24abd76c0957" status: 200 len: 1264 microversion: 2.1 time: 0.179287 Aug 09 02:48:32.136274 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 508/985] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:48:31 2022] GET /compute/v2.1/servers/088a9dcc-2c63-4ce0-803a-24abd76c0957 => generated 1264 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:48:32.274562 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO oslo.messaging._drivers.impl_rabbit [None req-5200d85e-933a-424b-b92c-c41b3253f900 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] [f8b25369-d8db-49a1-8d8d-44915e3adfe9] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 34070. Aug 09 02:48:32.303940 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-5200d85e-933a-424b-b92c-c41b3253f900 tempest-TestShelveInstance-11735074 tempest-TestShelveInstance-11735074-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2001242133" status: 202 len: 0 microversion: 2.1 time: 1.053148 Aug 09 02:48:32.304530 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 478/986] 10.222.0.20 () {58 vars in 1254 bytes} [Tue Aug 9 02:48:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2001242133 => generated 0 bytes in 1055 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 02:48:33.156881 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-79aff289-7d95-44e8-b7f1-c5deafa75357 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:48:33.157498 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-79aff289-7d95-44e8-b7f1-c5deafa75357 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 088a9dcc-2c63-4ce0-803a-24abd76c0957] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:48:33.164724 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-79aff289-7d95-44e8-b7f1-c5deafa75357 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:33.165210 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-79aff289-7d95-44e8-b7f1-c5deafa75357 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:33.165641 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-79aff289-7d95-44e8-b7f1-c5deafa75357 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:33.166388 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-79aff289-7d95-44e8-b7f1-c5deafa75357 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:33.166816 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-79aff289-7d95-44e8-b7f1-c5deafa75357 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:33.167237 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-79aff289-7d95-44e8-b7f1-c5deafa75357 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:33.384501 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-79aff289-7d95-44e8-b7f1-c5deafa75357 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:48:33.392372 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-79aff289-7d95-44e8-b7f1-c5deafa75357 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/088a9dcc-2c63-4ce0-803a-24abd76c0957" status: 200 len: 1264 microversion: 2.1 time: 0.239495 Aug 09 02:48:33.392953 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 509/987] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:48:33 2022] GET /compute/v2.1/servers/088a9dcc-2c63-4ce0-803a-24abd76c0957 => generated 1264 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:48:34.414527 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-c452e5b4-b9fa-4a4c-b1b0-185ad957aa64 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:48:34.415743 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-c452e5b4-b9fa-4a4c-b1b0-185ad957aa64 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 088a9dcc-2c63-4ce0-803a-24abd76c0957] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:48:34.423548 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c452e5b4-b9fa-4a4c-b1b0-185ad957aa64 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:34.424039 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c452e5b4-b9fa-4a4c-b1b0-185ad957aa64 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:34.424479 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c452e5b4-b9fa-4a4c-b1b0-185ad957aa64 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:34.425278 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c452e5b4-b9fa-4a4c-b1b0-185ad957aa64 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:34.425625 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c452e5b4-b9fa-4a4c-b1b0-185ad957aa64 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:34.426051 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c452e5b4-b9fa-4a4c-b1b0-185ad957aa64 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:34.652628 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-c452e5b4-b9fa-4a4c-b1b0-185ad957aa64 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:48:34.660663 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-c452e5b4-b9fa-4a4c-b1b0-185ad957aa64 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/088a9dcc-2c63-4ce0-803a-24abd76c0957" status: 200 len: 1264 microversion: 2.1 time: 0.251547 Aug 09 02:48:34.661557 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 479/988] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:48:34 2022] GET /compute/v2.1/servers/088a9dcc-2c63-4ce0-803a-24abd76c0957 => generated 1264 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:48:35.107280 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [req-8f8f80ff-8293-4cdc-b604-6d9229cf9ffd req-8ae4a69b-381b-4823-9bd5-9568f7ae1a11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "088a9dcc-2c63-4ce0-803a-24abd76c0957", "name": "network-vif-plugged", "status": "completed", "tag": "83f25e4f-a0a2-405d-90b0-5f49d4471e1e"}]} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:48:35.123637 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-8f8f80ff-8293-4cdc-b604-6d9229cf9ffd req-8ae4a69b-381b-4823-9bd5-9568f7ae1a11 service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:35.129811 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-8f8f80ff-8293-4cdc-b604-6d9229cf9ffd req-8ae4a69b-381b-4823-9bd5-9568f7ae1a11 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:35.130337 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-8f8f80ff-8293-4cdc-b604-6d9229cf9ffd req-8ae4a69b-381b-4823-9bd5-9568f7ae1a11 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:35.146948 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.compute.server_external_events [req-8f8f80ff-8293-4cdc-b604-6d9229cf9ffd req-8ae4a69b-381b-4823-9bd5-9568f7ae1a11 service nova] Creating event network-vif-plugged:83f25e4f-a0a2-405d-90b0-5f49d4471e1e for instance 088a9dcc-2c63-4ce0-803a-24abd76c0957 on hv-cinder-85246 Aug 09 02:48:35.155980 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [req-8f8f80ff-8293-4cdc-b604-6d9229cf9ffd req-8ae4a69b-381b-4823-9bd5-9568f7ae1a11 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052937 Aug 09 02:48:35.156751 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 510/989] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:48:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:48:35.681530 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-ce730de7-1837-4415-9844-46c0b4c0e22a tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:48:35.683257 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-ce730de7-1837-4415-9844-46c0b4c0e22a tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 088a9dcc-2c63-4ce0-803a-24abd76c0957] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:48:35.690841 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ce730de7-1837-4415-9844-46c0b4c0e22a tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:35.691567 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ce730de7-1837-4415-9844-46c0b4c0e22a tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:35.692163 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ce730de7-1837-4415-9844-46c0b4c0e22a tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:35.693289 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ce730de7-1837-4415-9844-46c0b4c0e22a tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:35.695154 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ce730de7-1837-4415-9844-46c0b4c0e22a tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:35.695597 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ce730de7-1837-4415-9844-46c0b4c0e22a tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:35.867963 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-ce730de7-1837-4415-9844-46c0b4c0e22a tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:48:35.876204 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-ce730de7-1837-4415-9844-46c0b4c0e22a tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/088a9dcc-2c63-4ce0-803a-24abd76c0957" status: 200 len: 1264 microversion: 2.1 time: 0.198903 Aug 09 02:48:35.877126 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 480/990] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:48:35 2022] GET /compute/v2.1/servers/088a9dcc-2c63-4ce0-803a-24abd76c0957 => generated 1264 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:48:36.898013 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-ede48434-dfd6-47bd-872b-bf23b9d42902 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:48:36.898894 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-ede48434-dfd6-47bd-872b-bf23b9d42902 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 088a9dcc-2c63-4ce0-803a-24abd76c0957] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:48:36.911329 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ede48434-dfd6-47bd-872b-bf23b9d42902 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:36.911847 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ede48434-dfd6-47bd-872b-bf23b9d42902 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:36.912290 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ede48434-dfd6-47bd-872b-bf23b9d42902 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:36.913017 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ede48434-dfd6-47bd-872b-bf23b9d42902 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:36.913466 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ede48434-dfd6-47bd-872b-bf23b9d42902 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:36.913884 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ede48434-dfd6-47bd-872b-bf23b9d42902 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:37.146889 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-ede48434-dfd6-47bd-872b-bf23b9d42902 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:48:37.155382 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-ede48434-dfd6-47bd-872b-bf23b9d42902 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/088a9dcc-2c63-4ce0-803a-24abd76c0957" status: 200 len: 1264 microversion: 2.1 time: 0.262055 Aug 09 02:48:37.156279 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 511/991] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:48:36 2022] GET /compute/v2.1/servers/088a9dcc-2c63-4ce0-803a-24abd76c0957 => generated 1264 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:48:38.178278 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-24a9da54-9f60-4136-a1a6-3a86aadcfa41 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:48:38.179544 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-24a9da54-9f60-4136-a1a6-3a86aadcfa41 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 088a9dcc-2c63-4ce0-803a-24abd76c0957] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:48:38.186200 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-24a9da54-9f60-4136-a1a6-3a86aadcfa41 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:38.187102 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-24a9da54-9f60-4136-a1a6-3a86aadcfa41 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:38.187535 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-24a9da54-9f60-4136-a1a6-3a86aadcfa41 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:38.188233 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-24a9da54-9f60-4136-a1a6-3a86aadcfa41 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:38.188676 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-24a9da54-9f60-4136-a1a6-3a86aadcfa41 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:38.189099 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-24a9da54-9f60-4136-a1a6-3a86aadcfa41 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:38.429569 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-24a9da54-9f60-4136-a1a6-3a86aadcfa41 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:48:38.437867 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-24a9da54-9f60-4136-a1a6-3a86aadcfa41 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/088a9dcc-2c63-4ce0-803a-24abd76c0957" status: 200 len: 1451 microversion: 2.1 time: 0.263893 Aug 09 02:48:38.438500 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 481/992] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:48:38 2022] GET /compute/v2.1/servers/088a9dcc-2c63-4ce0-803a-24abd76c0957 => generated 1451 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:48:38.458121 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-ee891bd8-9a23-448c-ae79-eb5ba98a3dd7 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:48:38.458769 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-ee891bd8-9a23-448c-ae79-eb5ba98a3dd7 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 088a9dcc-2c63-4ce0-803a-24abd76c0957] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:48:38.465228 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ee891bd8-9a23-448c-ae79-eb5ba98a3dd7 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:38.465806 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ee891bd8-9a23-448c-ae79-eb5ba98a3dd7 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:38.466267 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ee891bd8-9a23-448c-ae79-eb5ba98a3dd7 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:38.467001 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ee891bd8-9a23-448c-ae79-eb5ba98a3dd7 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:38.467455 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ee891bd8-9a23-448c-ae79-eb5ba98a3dd7 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:38.467877 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-ee891bd8-9a23-448c-ae79-eb5ba98a3dd7 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:38.706538 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-ee891bd8-9a23-448c-ae79-eb5ba98a3dd7 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:48:38.715323 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-ee891bd8-9a23-448c-ae79-eb5ba98a3dd7 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/088a9dcc-2c63-4ce0-803a-24abd76c0957" status: 200 len: 1451 microversion: 2.1 time: 0.261057 Aug 09 02:48:38.726770 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 512/993] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:48:38 2022] GET /compute/v2.1/servers/088a9dcc-2c63-4ce0-803a-24abd76c0957 => generated 1451 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:48:40.900801 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [req-b845fb7e-e019-4d27-a116-e70f3a3e7de7 req-9007f719-22b2-4839-9276-3505dd130107 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "088a9dcc-2c63-4ce0-803a-24abd76c0957", "tag": "83f25e4f-a0a2-405d-90b0-5f49d4471e1e"}]} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:48:40.913208 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-b845fb7e-e019-4d27-a116-e70f3a3e7de7 req-9007f719-22b2-4839-9276-3505dd130107 service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:40.914276 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-b845fb7e-e019-4d27-a116-e70f3a3e7de7 req-9007f719-22b2-4839-9276-3505dd130107 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:40.915114 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-b845fb7e-e019-4d27-a116-e70f3a3e7de7 req-9007f719-22b2-4839-9276-3505dd130107 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:40.929272 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.compute.server_external_events [req-b845fb7e-e019-4d27-a116-e70f3a3e7de7 req-9007f719-22b2-4839-9276-3505dd130107 service nova] Creating event network-changed:83f25e4f-a0a2-405d-90b0-5f49d4471e1e for instance 088a9dcc-2c63-4ce0-803a-24abd76c0957 on hv-cinder-85246 Aug 09 02:48:40.935273 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [req-b845fb7e-e019-4d27-a116-e70f3a3e7de7 req-9007f719-22b2-4839-9276-3505dd130107 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039248 Aug 09 02:48:40.936548 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 482/994] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:48:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:48:43.062387 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-a69cc230-e2a8-4bd1-aed4-befa6755d762 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:48:43.064553 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-a69cc230-e2a8-4bd1-aed4-befa6755d762 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:48:43.071404 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a69cc230-e2a8-4bd1-aed4-befa6755d762 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:43.071878 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a69cc230-e2a8-4bd1-aed4-befa6755d762 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:43.072308 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a69cc230-e2a8-4bd1-aed4-befa6755d762 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:43.072984 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a69cc230-e2a8-4bd1-aed4-befa6755d762 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:43.073429 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a69cc230-e2a8-4bd1-aed4-befa6755d762 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:43.073849 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a69cc230-e2a8-4bd1-aed4-befa6755d762 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:43.102416 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-a69cc230-e2a8-4bd1-aed4-befa6755d762 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044242 Aug 09 02:48:43.102965 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 513/995] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Aug 9 02:48:43 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:48:43.169659 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-5a08c1ae-bb56-4a41-b1a1-f2354f628ee7 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:48:43.170300 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-5a08c1ae-bb56-4a41-b1a1-f2354f628ee7 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:48:43.176797 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-5a08c1ae-bb56-4a41-b1a1-f2354f628ee7 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:43.177276 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-5a08c1ae-bb56-4a41-b1a1-f2354f628ee7 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:43.177694 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-5a08c1ae-bb56-4a41-b1a1-f2354f628ee7 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:43.178412 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-5a08c1ae-bb56-4a41-b1a1-f2354f628ee7 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:43.178853 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-5a08c1ae-bb56-4a41-b1a1-f2354f628ee7 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:43.179265 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-5a08c1ae-bb56-4a41-b1a1-f2354f628ee7 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:43.204148 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-5a08c1ae-bb56-4a41-b1a1-f2354f628ee7 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Going to try to terminate instance {{(pid=124425) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 02:48:43.282538 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-5a08c1ae-bb56-4a41-b1a1-f2354f628ee7 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "DELETE /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 204 len: 0 microversion: 2.20 time: 0.117491 Aug 09 02:48:43.283042 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 483/996] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Aug 9 02:48:43 2022] DELETE /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 02:48:43.291657 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-2e3dcc0e-395a-4e32-82c0-813016319aab tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:48:43.292357 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-2e3dcc0e-395a-4e32-82c0-813016319aab tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:48:43.299642 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2e3dcc0e-395a-4e32-82c0-813016319aab tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:43.300363 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2e3dcc0e-395a-4e32-82c0-813016319aab tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:43.300972 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2e3dcc0e-395a-4e32-82c0-813016319aab tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:43.302024 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2e3dcc0e-395a-4e32-82c0-813016319aab tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:43.302803 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2e3dcc0e-395a-4e32-82c0-813016319aab tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:43.303425 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2e3dcc0e-395a-4e32-82c0-813016319aab tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:43.448740 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-2e3dcc0e-395a-4e32-82c0-813016319aab tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:48:43.457231 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-2e3dcc0e-395a-4e32-82c0-813016319aab tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:48:43.458755 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-2e3dcc0e-395a-4e32-82c0-813016319aab tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:48:43.459908 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-2e3dcc0e-395a-4e32-82c0-813016319aab tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 200 len: 1720 microversion: 2.20 time: 0.172284 Aug 09 02:48:43.460432 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 514/997] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:48:43 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 1720 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 02:48:44.483643 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-fa9b4318-d5ee-42d7-a6a2-4d0c526e6876 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:48:44.484320 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-fa9b4318-d5ee-42d7-a6a2-4d0c526e6876 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:48:44.491349 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-fa9b4318-d5ee-42d7-a6a2-4d0c526e6876 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:44.491827 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-fa9b4318-d5ee-42d7-a6a2-4d0c526e6876 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:44.492259 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-fa9b4318-d5ee-42d7-a6a2-4d0c526e6876 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:44.492977 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-fa9b4318-d5ee-42d7-a6a2-4d0c526e6876 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:44.493423 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-fa9b4318-d5ee-42d7-a6a2-4d0c526e6876 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:44.493840 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-fa9b4318-d5ee-42d7-a6a2-4d0c526e6876 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:44.638416 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-fa9b4318-d5ee-42d7-a6a2-4d0c526e6876 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:48:44.646538 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-fa9b4318-d5ee-42d7-a6a2-4d0c526e6876 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:48:44.648026 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-fa9b4318-d5ee-42d7-a6a2-4d0c526e6876 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:48:44.649189 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-fa9b4318-d5ee-42d7-a6a2-4d0c526e6876 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 200 len: 1720 microversion: 2.20 time: 0.170015 Aug 09 02:48:44.649746 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 484/998] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:48:44 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 1720 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:48:45.672752 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-a4370365-65e8-49c1-b1b1-5741520fcd3c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:48:45.674026 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-a4370365-65e8-49c1-b1b1-5741520fcd3c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:48:45.681076 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a4370365-65e8-49c1-b1b1-5741520fcd3c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:45.681578 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a4370365-65e8-49c1-b1b1-5741520fcd3c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:45.682009 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a4370365-65e8-49c1-b1b1-5741520fcd3c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:45.682753 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a4370365-65e8-49c1-b1b1-5741520fcd3c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:45.683401 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a4370365-65e8-49c1-b1b1-5741520fcd3c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:45.683851 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a4370365-65e8-49c1-b1b1-5741520fcd3c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:45.763268 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-a4370365-65e8-49c1-b1b1-5741520fcd3c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:48:45.771876 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-a4370365-65e8-49c1-b1b1-5741520fcd3c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:48:45.773415 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-a4370365-65e8-49c1-b1b1-5741520fcd3c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81447e83a97b4519ac6d0eac9a06bdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6695b7eb3b40ecb4d46292a95e6122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:48:45.774677 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-a4370365-65e8-49c1-b1b1-5741520fcd3c tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 200 len: 1652 microversion: 2.20 time: 0.106141 Aug 09 02:48:45.775222 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 515/999] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:48:45 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 1652 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 02:48:46.038105 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [req-58d40de7-8d73-46f2-bdd8-3e0892c910dc req-91744009-c1c6-46b9-95d6-0b695e3eca65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01aef713-9cfa-4840-829f-b5d30b2f9549", "name": "network-vif-deleted", "tag": "c771a4c1-387c-4632-a527-0af0b51cc089"}]} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:48:46.052082 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-58d40de7-8d73-46f2-bdd8-3e0892c910dc req-91744009-c1c6-46b9-95d6-0b695e3eca65 service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:46.052625 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-58d40de7-8d73-46f2-bdd8-3e0892c910dc req-91744009-c1c6-46b9-95d6-0b695e3eca65 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:46.053498 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-58d40de7-8d73-46f2-bdd8-3e0892c910dc req-91744009-c1c6-46b9-95d6-0b695e3eca65 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:46.067389 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.compute.server_external_events [req-58d40de7-8d73-46f2-bdd8-3e0892c910dc req-91744009-c1c6-46b9-95d6-0b695e3eca65 service nova] Creating event network-vif-deleted:c771a4c1-387c-4632-a527-0af0b51cc089 for instance 01aef713-9cfa-4840-829f-b5d30b2f9549 on hv-cinder-85246 Aug 09 02:48:46.074391 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [req-58d40de7-8d73-46f2-bdd8-3e0892c910dc req-91744009-c1c6-46b9-95d6-0b695e3eca65 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040011 Aug 09 02:48:46.075586 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 485/1000] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:48:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:48:46.796977 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-21c7032a-e0f6-4081-b666-b67fcc3ec83a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:48:46.797638 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-21c7032a-e0f6-4081-b666-b67fcc3ec83a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:48:46.804644 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-21c7032a-e0f6-4081-b666-b67fcc3ec83a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:46.805126 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-21c7032a-e0f6-4081-b666-b67fcc3ec83a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:46.805554 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-21c7032a-e0f6-4081-b666-b67fcc3ec83a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:46.806286 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-21c7032a-e0f6-4081-b666-b67fcc3ec83a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:46.806768 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-21c7032a-e0f6-4081-b666-b67fcc3ec83a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:46.807185 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-21c7032a-e0f6-4081-b666-b67fcc3ec83a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:46.822306 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.wsgi [None req-21c7032a-e0f6-4081-b666-b67fcc3ec83a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] HTTP exception thrown: Instance 01aef713-9cfa-4840-829f-b5d30b2f9549 could not be found. Aug 09 02:48:46.824084 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-21c7032a-e0f6-4081-b666-b67fcc3ec83a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Request method failure captured: Aug 09 02:48:46.824084 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: request: GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 HTTP/1.1 Aug 09 02:48:46.824084 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Accept: application/json Aug 09 02:48:46.824084 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Accept-Encoding: identity Aug 09 02:48:46.824084 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Connection: close Aug 09 02:48:46.824084 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Content-Length: 0 Aug 09 02:48:46.824084 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Content-Type: application/json Aug 09 02:48:46.824084 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Host: 10.222.0.20 Aug 09 02:48:46.824084 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Openstack-System-Scope: None Aug 09 02:48:46.824084 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: User-Agent: python-urllib3/1.26.11 Aug 09 02:48:46.824084 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Auth-Token: gAAAAABi8cl7VgtcdjqsQual3MD2n3KDeY2pZDvdEFD-XPiqcIb6Stef9SKYhMK8dK6AGBzSLHh26_dFHM84KfJw3HBg6ihOE4BQBRRVkGIEwE_TX8a64dEtvPhI7kLhEdt2_PmyuhNl8FCMcrnIQpXxk41_FkyvCMQZmHwG5i5erC5vonxRS6o Aug 09 02:48:46.824084 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Domain-Id: None Aug 09 02:48:46.824084 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Domain-Name: None Aug 09 02:48:46.824084 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Identity-Status: Confirmed Aug 09 02:48:46.824084 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Is-Admin-Project: True Aug 09 02:48:46.824084 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 02:48:46.824084 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Domain-Id: default Aug 09 02:48:46.824084 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Domain-Name: Default Aug 09 02:48:46.824084 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Id: ca6695b7eb3b40ecb4d46292a95e6122 Aug 09 02:48:46.824084 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1993749218 Aug 09 02:48:46.824084 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Role: reader,member Aug 09 02:48:46.824084 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Roles: reader,member Aug 09 02:48:46.825870 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ca6695b7eb3b40ecb4d46292a95e6122"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ca6695b7eb3b40ecb4d46292a95e6122"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ca6695b7eb3b40ecb4d46292a95e6122"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ca6695b7eb3b40ecb4d46292a95e6122"}]}] Aug 09 02:48:46.825870 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1993749218 Aug 09 02:48:46.825870 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant-Id: ca6695b7eb3b40ecb4d46292a95e6122 Aug 09 02:48:46.825870 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1993749218 Aug 09 02:48:46.825870 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User: tempest-AttachVolumeShelveTestJSON-1993749218-project Aug 09 02:48:46.825870 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Domain-Id: default Aug 09 02:48:46.825870 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Domain-Name: Default Aug 09 02:48:46.825870 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Id: 81447e83a97b4519ac6d0eac9a06bdef Aug 09 02:48:46.825870 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1993749218-project Aug 09 02:48:46.825870 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: method: > Aug 09 02:48:46.825870 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: exception: Instance 01aef713-9cfa-4840-829f-b5d30b2f9549 could not be found. Aug 09 02:48:46.825870 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: action_args: {'id': '01aef713-9cfa-4840-829f-b5d30b2f9549'} Aug 09 02:48:46.826919 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 02:48:46.826919 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:48:46.826919 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 02:48:46.826919 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 02:48:46.826919 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 02:48:46.826919 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 02:48:46.826919 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 02:48:46.826919 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 02:48:46.826919 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 02:48:46.826919 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 02:48:46.826919 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01aef713-9cfa-4840-829f-b5d30b2f9549 could not be found. Aug 09 02:48:46.826919 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:48:46.826919 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:48:46.826919 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:48:46.826919 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:48:46.826919 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:48:46.826919 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:48:46.826919 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 02:48:46.826919 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 02:48:46.826919 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 02:48:46.828480 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 02:48:46.828480 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 02:48:46.828480 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 02:48:46.828480 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 02:48:46.828480 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 02:48:46.828480 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 02:48:46.828480 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 02:48:46.828480 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01aef713-9cfa-4840-829f-b5d30b2f9549 could not be found. Aug 09 02:48:46.828480 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:48:46.828480 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:48:46.828480 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:48:46.828480 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:48:46.828480 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:48:46.828480 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:48:46.828480 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 02:48:46.828480 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 02:48:46.828480 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01aef713-9cfa-4840-829f-b5d30b2f9549 could not be found. Aug 09 02:48:46.828480 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:48:46.830023 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-21c7032a-e0f6-4081-b666-b67fcc3ec83a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Returning 404 to user: Instance 01aef713-9cfa-4840-829f-b5d30b2f9549 could not be found. {{(pid=124427) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 02:48:46.830972 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-21c7032a-e0f6-4081-b666-b67fcc3ec83a tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 404 len: 111 microversion: 2.20 time: 0.038119 Aug 09 02:48:46.831524 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 516/1001] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:48:46 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 02:48:46.840801 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-ff29b17f-fead-406d-a7b6-ffe535e3f6f3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '.version_select at 0x7fb0a0493700>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:48:46.860758 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-ff29b17f-fead-406d-a7b6-ffe535e3f6f3 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-222512131" status: 204 len: 0 microversion: 2.20 time: 0.024171 Aug 09 02:48:46.861638 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 486/1002] 10.222.0.20 () {60 vars in 1259 bytes} [Tue Aug 9 02:48:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-222512131 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 02:48:48.668099 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-98306875-330f-49f9-b7ff-241ed854ff82 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:48:48.668609 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-98306875-330f-49f9-b7ff-241ed854ff82 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:48:48.675461 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-98306875-330f-49f9-b7ff-241ed854ff82 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:48.675969 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-98306875-330f-49f9-b7ff-241ed854ff82 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:48.676398 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-98306875-330f-49f9-b7ff-241ed854ff82 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:48.677073 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-98306875-330f-49f9-b7ff-241ed854ff82 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:48.677518 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-98306875-330f-49f9-b7ff-241ed854ff82 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:48.677932 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-98306875-330f-49f9-b7ff-241ed854ff82 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:48.681999 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:48:48.692592 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.wsgi [None req-98306875-330f-49f9-b7ff-241ed854ff82 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] HTTP exception thrown: Instance 01aef713-9cfa-4840-829f-b5d30b2f9549 could not be found. Aug 09 02:48:48.694305 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-98306875-330f-49f9-b7ff-241ed854ff82 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Request method failure captured: Aug 09 02:48:48.694305 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: request: DELETE /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 HTTP/1.1 Aug 09 02:48:48.694305 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Accept: application/json Aug 09 02:48:48.694305 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Accept-Encoding: identity Aug 09 02:48:48.694305 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Connection: close Aug 09 02:48:48.694305 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Content-Length: 0 Aug 09 02:48:48.694305 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Content-Type: application/json Aug 09 02:48:48.694305 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Host: 10.222.0.20 Aug 09 02:48:48.694305 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Openstack-System-Scope: None Aug 09 02:48:48.694305 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: User-Agent: python-urllib3/1.26.11 Aug 09 02:48:48.694305 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Auth-Token: gAAAAABi8cl7VgtcdjqsQual3MD2n3KDeY2pZDvdEFD-XPiqcIb6Stef9SKYhMK8dK6AGBzSLHh26_dFHM84KfJw3HBg6ihOE4BQBRRVkGIEwE_TX8a64dEtvPhI7kLhEdt2_PmyuhNl8FCMcrnIQpXxk41_FkyvCMQZmHwG5i5erC5vonxRS6o Aug 09 02:48:48.694305 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Domain-Id: None Aug 09 02:48:48.694305 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Domain-Name: None Aug 09 02:48:48.694305 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Identity-Status: Confirmed Aug 09 02:48:48.694305 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Is-Admin-Project: True Aug 09 02:48:48.694305 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 02:48:48.694305 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Domain-Id: default Aug 09 02:48:48.694305 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Domain-Name: Default Aug 09 02:48:48.694305 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Id: ca6695b7eb3b40ecb4d46292a95e6122 Aug 09 02:48:48.694305 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1993749218 Aug 09 02:48:48.694305 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Role: reader,member Aug 09 02:48:48.694305 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Roles: reader,member Aug 09 02:48:48.695972 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ca6695b7eb3b40ecb4d46292a95e6122"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ca6695b7eb3b40ecb4d46292a95e6122"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ca6695b7eb3b40ecb4d46292a95e6122"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ca6695b7eb3b40ecb4d46292a95e6122"}]}] Aug 09 02:48:48.695972 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1993749218 Aug 09 02:48:48.695972 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant-Id: ca6695b7eb3b40ecb4d46292a95e6122 Aug 09 02:48:48.695972 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1993749218 Aug 09 02:48:48.695972 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User: tempest-AttachVolumeShelveTestJSON-1993749218-project Aug 09 02:48:48.695972 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Domain-Id: default Aug 09 02:48:48.695972 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Domain-Name: Default Aug 09 02:48:48.695972 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Id: 81447e83a97b4519ac6d0eac9a06bdef Aug 09 02:48:48.695972 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1993749218-project Aug 09 02:48:48.695972 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: method: > Aug 09 02:48:48.695972 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: exception: Instance 01aef713-9cfa-4840-829f-b5d30b2f9549 could not be found. Aug 09 02:48:48.695972 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: action_args: {'id': '01aef713-9cfa-4840-829f-b5d30b2f9549'} Aug 09 02:48:48.696788 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 02:48:48.696788 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:48:48.696788 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 02:48:48.696788 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 02:48:48.696788 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 02:48:48.696788 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 02:48:48.696788 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 02:48:48.696788 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 02:48:48.696788 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 02:48:48.696788 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 02:48:48.696788 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01aef713-9cfa-4840-829f-b5d30b2f9549 could not be found. Aug 09 02:48:48.696788 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:48:48.696788 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:48:48.696788 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:48:48.696788 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:48:48.696788 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:48:48.696788 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:48:48.696788 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 02:48:48.696788 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 02:48:48.696788 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 02:48:48.698085 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 02:48:48.698085 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 02:48:48.698085 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 02:48:48.698085 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 02:48:48.698085 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 02:48:48.698085 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 02:48:48.698085 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 02:48:48.698085 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 02:48:48.698085 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 02:48:48.698085 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01aef713-9cfa-4840-829f-b5d30b2f9549 could not be found. Aug 09 02:48:48.698085 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:48:48.698085 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:48:48.698085 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:48:48.698085 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:48:48.698085 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:48:48.698085 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:48:48.698085 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 02:48:48.698085 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 02:48:48.698085 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01aef713-9cfa-4840-829f-b5d30b2f9549 could not be found. Aug 09 02:48:48.698085 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:48:48.699420 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-98306875-330f-49f9-b7ff-241ed854ff82 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Returning 404 to user: Instance 01aef713-9cfa-4840-829f-b5d30b2f9549 could not be found. {{(pid=124427) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 02:48:48.699420 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-98306875-330f-49f9-b7ff-241ed854ff82 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "DELETE /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 404 len: 111 microversion: 2.20 time: 0.031535 Aug 09 02:48:48.699420 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 517/1003] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Aug 9 02:48:48 2022] DELETE /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 02:48:48.705015 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-0cfa3884-c821-4e0c-8b69-4d0b39a6cd06 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:48:48.705746 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-0cfa3884-c821-4e0c-8b69-4d0b39a6cd06 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 01aef713-9cfa-4840-829f-b5d30b2f9549] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:48:48.712495 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0cfa3884-c821-4e0c-8b69-4d0b39a6cd06 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:48.712975 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0cfa3884-c821-4e0c-8b69-4d0b39a6cd06 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:48.713393 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0cfa3884-c821-4e0c-8b69-4d0b39a6cd06 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:48.714278 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0cfa3884-c821-4e0c-8b69-4d0b39a6cd06 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:48.714716 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0cfa3884-c821-4e0c-8b69-4d0b39a6cd06 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:48.715130 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0cfa3884-c821-4e0c-8b69-4d0b39a6cd06 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:48.728609 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.wsgi [None req-0cfa3884-c821-4e0c-8b69-4d0b39a6cd06 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] HTTP exception thrown: Instance 01aef713-9cfa-4840-829f-b5d30b2f9549 could not be found. Aug 09 02:48:48.730281 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-0cfa3884-c821-4e0c-8b69-4d0b39a6cd06 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Request method failure captured: Aug 09 02:48:48.730281 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: request: GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 HTTP/1.1 Aug 09 02:48:48.730281 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Accept: application/json Aug 09 02:48:48.730281 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Accept-Encoding: identity Aug 09 02:48:48.730281 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Connection: close Aug 09 02:48:48.730281 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Content-Length: 0 Aug 09 02:48:48.730281 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Content-Type: application/json Aug 09 02:48:48.730281 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Host: 10.222.0.20 Aug 09 02:48:48.730281 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Openstack-System-Scope: None Aug 09 02:48:48.730281 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: User-Agent: python-urllib3/1.26.11 Aug 09 02:48:48.730281 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Auth-Token: gAAAAABi8cl7VgtcdjqsQual3MD2n3KDeY2pZDvdEFD-XPiqcIb6Stef9SKYhMK8dK6AGBzSLHh26_dFHM84KfJw3HBg6ihOE4BQBRRVkGIEwE_TX8a64dEtvPhI7kLhEdt2_PmyuhNl8FCMcrnIQpXxk41_FkyvCMQZmHwG5i5erC5vonxRS6o Aug 09 02:48:48.730281 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Domain-Id: None Aug 09 02:48:48.730281 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Domain-Name: None Aug 09 02:48:48.730281 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Identity-Status: Confirmed Aug 09 02:48:48.730281 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Is-Admin-Project: True Aug 09 02:48:48.730281 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 02:48:48.730281 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Domain-Id: default Aug 09 02:48:48.730281 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Domain-Name: Default Aug 09 02:48:48.730281 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Id: ca6695b7eb3b40ecb4d46292a95e6122 Aug 09 02:48:48.730281 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1993749218 Aug 09 02:48:48.730281 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Role: reader,member Aug 09 02:48:48.730281 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Roles: reader,member Aug 09 02:48:48.732040 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ca6695b7eb3b40ecb4d46292a95e6122"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ca6695b7eb3b40ecb4d46292a95e6122"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ca6695b7eb3b40ecb4d46292a95e6122"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ca6695b7eb3b40ecb4d46292a95e6122"}]}] Aug 09 02:48:48.732040 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1993749218 Aug 09 02:48:48.732040 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant-Id: ca6695b7eb3b40ecb4d46292a95e6122 Aug 09 02:48:48.732040 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1993749218 Aug 09 02:48:48.732040 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User: tempest-AttachVolumeShelveTestJSON-1993749218-project Aug 09 02:48:48.732040 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Domain-Id: default Aug 09 02:48:48.732040 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Domain-Name: Default Aug 09 02:48:48.732040 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Id: 81447e83a97b4519ac6d0eac9a06bdef Aug 09 02:48:48.732040 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1993749218-project Aug 09 02:48:48.732040 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: method: > Aug 09 02:48:48.732040 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: exception: Instance 01aef713-9cfa-4840-829f-b5d30b2f9549 could not be found. Aug 09 02:48:48.732040 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: action_args: {'id': '01aef713-9cfa-4840-829f-b5d30b2f9549'} Aug 09 02:48:48.732960 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 02:48:48.732960 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:48:48.732960 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 02:48:48.732960 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 02:48:48.732960 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 02:48:48.732960 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 02:48:48.732960 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 02:48:48.732960 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 02:48:48.732960 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 02:48:48.732960 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 02:48:48.732960 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01aef713-9cfa-4840-829f-b5d30b2f9549 could not be found. Aug 09 02:48:48.732960 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:48:48.732960 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:48:48.732960 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:48:48.732960 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:48:48.732960 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:48:48.732960 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:48:48.732960 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 02:48:48.732960 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 02:48:48.732960 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 02:48:48.734440 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 02:48:48.734440 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 02:48:48.734440 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 02:48:48.734440 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 02:48:48.734440 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 02:48:48.734440 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 02:48:48.734440 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 02:48:48.734440 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01aef713-9cfa-4840-829f-b5d30b2f9549 could not be found. Aug 09 02:48:48.734440 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:48:48.734440 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:48:48.734440 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:48:48.734440 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:48:48.734440 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:48:48.734440 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:48:48.734440 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 02:48:48.734440 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 02:48:48.734440 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01aef713-9cfa-4840-829f-b5d30b2f9549 could not be found. Aug 09 02:48:48.734440 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:48:48.735836 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-0cfa3884-c821-4e0c-8b69-4d0b39a6cd06 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Returning 404 to user: Instance 01aef713-9cfa-4840-829f-b5d30b2f9549 could not be found. {{(pid=124425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 02:48:48.735836 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-0cfa3884-c821-4e0c-8b69-4d0b39a6cd06 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549" status: 404 len: 111 microversion: 2.20 time: 0.031213 Aug 09 02:48:48.735836 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 487/1004] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:48:48 2022] GET /compute/v2.1/servers/01aef713-9cfa-4840-829f-b5d30b2f9549 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 02:48:49.877861 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-41cdfa7d-b1b9-4b5f-be7b-6ff7993f9320 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:48:49.878408 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-41cdfa7d-b1b9-4b5f-be7b-6ff7993f9320 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:48:49.885921 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-41cdfa7d-b1b9-4b5f-be7b-6ff7993f9320 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:49.886438 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-41cdfa7d-b1b9-4b5f-be7b-6ff7993f9320 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:49.886875 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-41cdfa7d-b1b9-4b5f-be7b-6ff7993f9320 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:49.887562 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-41cdfa7d-b1b9-4b5f-be7b-6ff7993f9320 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:49.888015 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-41cdfa7d-b1b9-4b5f-be7b-6ff7993f9320 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:49.888439 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-41cdfa7d-b1b9-4b5f-be7b-6ff7993f9320 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:49.902744 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.wsgi [None req-41cdfa7d-b1b9-4b5f-be7b-6ff7993f9320 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] HTTP exception thrown: Instance 9919dd32-c9e0-42ae-8981-414c2e663e73 could not be found. Aug 09 02:48:49.904303 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-41cdfa7d-b1b9-4b5f-be7b-6ff7993f9320 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Request method failure captured: Aug 09 02:48:49.904303 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: request: DELETE /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 HTTP/1.1 Aug 09 02:48:49.904303 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Accept: application/json Aug 09 02:48:49.904303 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Accept-Encoding: identity Aug 09 02:48:49.904303 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Connection: close Aug 09 02:48:49.904303 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Content-Length: 0 Aug 09 02:48:49.904303 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Content-Type: application/json Aug 09 02:48:49.904303 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Host: 10.222.0.20 Aug 09 02:48:49.904303 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Openstack-System-Scope: None Aug 09 02:48:49.904303 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: User-Agent: python-urllib3/1.26.11 Aug 09 02:48:49.904303 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Auth-Token: gAAAAABi8cl7VgtcdjqsQual3MD2n3KDeY2pZDvdEFD-XPiqcIb6Stef9SKYhMK8dK6AGBzSLHh26_dFHM84KfJw3HBg6ihOE4BQBRRVkGIEwE_TX8a64dEtvPhI7kLhEdt2_PmyuhNl8FCMcrnIQpXxk41_FkyvCMQZmHwG5i5erC5vonxRS6o Aug 09 02:48:49.904303 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Domain-Id: None Aug 09 02:48:49.904303 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Domain-Name: None Aug 09 02:48:49.904303 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Identity-Status: Confirmed Aug 09 02:48:49.904303 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Is-Admin-Project: True Aug 09 02:48:49.904303 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 02:48:49.904303 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Domain-Id: default Aug 09 02:48:49.904303 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Domain-Name: Default Aug 09 02:48:49.904303 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Id: ca6695b7eb3b40ecb4d46292a95e6122 Aug 09 02:48:49.904303 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1993749218 Aug 09 02:48:49.904303 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Role: reader,member Aug 09 02:48:49.904303 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Roles: reader,member Aug 09 02:48:49.905925 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ca6695b7eb3b40ecb4d46292a95e6122"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ca6695b7eb3b40ecb4d46292a95e6122"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ca6695b7eb3b40ecb4d46292a95e6122"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ca6695b7eb3b40ecb4d46292a95e6122"}]}] Aug 09 02:48:49.905925 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1993749218 Aug 09 02:48:49.905925 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant-Id: ca6695b7eb3b40ecb4d46292a95e6122 Aug 09 02:48:49.905925 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1993749218 Aug 09 02:48:49.905925 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User: tempest-AttachVolumeShelveTestJSON-1993749218-project Aug 09 02:48:49.905925 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Domain-Id: default Aug 09 02:48:49.905925 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Domain-Name: Default Aug 09 02:48:49.905925 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Id: 81447e83a97b4519ac6d0eac9a06bdef Aug 09 02:48:49.905925 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1993749218-project Aug 09 02:48:49.905925 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: method: > Aug 09 02:48:49.905925 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: exception: Instance 9919dd32-c9e0-42ae-8981-414c2e663e73 could not be found. Aug 09 02:48:49.905925 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: action_args: {'id': '9919dd32-c9e0-42ae-8981-414c2e663e73'} Aug 09 02:48:49.906883 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 02:48:49.906883 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:48:49.906883 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 02:48:49.906883 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 02:48:49.906883 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 02:48:49.906883 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 02:48:49.906883 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 02:48:49.906883 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 02:48:49.906883 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 02:48:49.906883 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 02:48:49.906883 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9919dd32-c9e0-42ae-8981-414c2e663e73 could not be found. Aug 09 02:48:49.906883 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:48:49.906883 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:48:49.906883 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:48:49.906883 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:48:49.906883 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:48:49.906883 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:48:49.906883 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 02:48:49.906883 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 02:48:49.906883 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 02:48:49.908184 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 02:48:49.908184 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 02:48:49.908184 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 02:48:49.908184 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 02:48:49.908184 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 02:48:49.908184 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 02:48:49.908184 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 02:48:49.908184 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 02:48:49.908184 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 02:48:49.908184 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9919dd32-c9e0-42ae-8981-414c2e663e73 could not be found. Aug 09 02:48:49.908184 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:48:49.908184 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:48:49.908184 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:48:49.908184 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:48:49.908184 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:48:49.908184 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:48:49.908184 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 02:48:49.908184 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 02:48:49.908184 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9919dd32-c9e0-42ae-8981-414c2e663e73 could not be found. Aug 09 02:48:49.908184 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:48:49.909456 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-41cdfa7d-b1b9-4b5f-be7b-6ff7993f9320 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Returning 404 to user: Instance 9919dd32-c9e0-42ae-8981-414c2e663e73 could not be found. {{(pid=124427) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 02:48:49.909456 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-41cdfa7d-b1b9-4b5f-be7b-6ff7993f9320 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 404 len: 111 microversion: 2.20 time: 0.031976 Aug 09 02:48:49.909456 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 518/1005] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Aug 9 02:48:49 2022] DELETE /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 02:48:49.914432 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-d8aeaba6-66a5-4258-9315-191d1d2c61d8 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:48:49.915040 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-d8aeaba6-66a5-4258-9315-191d1d2c61d8 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] [instance: 9919dd32-c9e0-42ae-8981-414c2e663e73] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:48:49.922586 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d8aeaba6-66a5-4258-9315-191d1d2c61d8 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:49.922586 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d8aeaba6-66a5-4258-9315-191d1d2c61d8 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:49.922897 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d8aeaba6-66a5-4258-9315-191d1d2c61d8 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:49.923638 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d8aeaba6-66a5-4258-9315-191d1d2c61d8 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:48:49.924053 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d8aeaba6-66a5-4258-9315-191d1d2c61d8 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:48:49.924688 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d8aeaba6-66a5-4258-9315-191d1d2c61d8 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:48:49.938825 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.wsgi [None req-d8aeaba6-66a5-4258-9315-191d1d2c61d8 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] HTTP exception thrown: Instance 9919dd32-c9e0-42ae-8981-414c2e663e73 could not be found. Aug 09 02:48:49.940399 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-d8aeaba6-66a5-4258-9315-191d1d2c61d8 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Request method failure captured: Aug 09 02:48:49.940399 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: request: GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 HTTP/1.1 Aug 09 02:48:49.940399 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Accept: application/json Aug 09 02:48:49.940399 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Accept-Encoding: identity Aug 09 02:48:49.940399 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Connection: close Aug 09 02:48:49.940399 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Content-Length: 0 Aug 09 02:48:49.940399 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Content-Type: application/json Aug 09 02:48:49.940399 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Host: 10.222.0.20 Aug 09 02:48:49.940399 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Openstack-System-Scope: None Aug 09 02:48:49.940399 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: User-Agent: python-urllib3/1.26.11 Aug 09 02:48:49.940399 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Auth-Token: gAAAAABi8cl7VgtcdjqsQual3MD2n3KDeY2pZDvdEFD-XPiqcIb6Stef9SKYhMK8dK6AGBzSLHh26_dFHM84KfJw3HBg6ihOE4BQBRRVkGIEwE_TX8a64dEtvPhI7kLhEdt2_PmyuhNl8FCMcrnIQpXxk41_FkyvCMQZmHwG5i5erC5vonxRS6o Aug 09 02:48:49.940399 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Domain-Id: None Aug 09 02:48:49.940399 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Domain-Name: None Aug 09 02:48:49.940399 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Identity-Status: Confirmed Aug 09 02:48:49.940399 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Is-Admin-Project: True Aug 09 02:48:49.940399 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 02:48:49.940399 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Domain-Id: default Aug 09 02:48:49.940399 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Domain-Name: Default Aug 09 02:48:49.940399 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Id: ca6695b7eb3b40ecb4d46292a95e6122 Aug 09 02:48:49.940399 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1993749218 Aug 09 02:48:49.940399 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Role: reader,member Aug 09 02:48:49.940399 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Roles: reader,member Aug 09 02:48:49.942073 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ca6695b7eb3b40ecb4d46292a95e6122"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ca6695b7eb3b40ecb4d46292a95e6122"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ca6695b7eb3b40ecb4d46292a95e6122"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ca6695b7eb3b40ecb4d46292a95e6122"}]}] Aug 09 02:48:49.942073 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1993749218 Aug 09 02:48:49.942073 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant-Id: ca6695b7eb3b40ecb4d46292a95e6122 Aug 09 02:48:49.942073 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1993749218 Aug 09 02:48:49.942073 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User: tempest-AttachVolumeShelveTestJSON-1993749218-project Aug 09 02:48:49.942073 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Domain-Id: default Aug 09 02:48:49.942073 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Domain-Name: Default Aug 09 02:48:49.942073 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Id: 81447e83a97b4519ac6d0eac9a06bdef Aug 09 02:48:49.942073 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1993749218-project Aug 09 02:48:49.942073 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: method: > Aug 09 02:48:49.942073 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: exception: Instance 9919dd32-c9e0-42ae-8981-414c2e663e73 could not be found. Aug 09 02:48:49.942073 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: action_args: {'id': '9919dd32-c9e0-42ae-8981-414c2e663e73'} Aug 09 02:48:49.943352 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 02:48:49.943352 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:48:49.943352 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 02:48:49.943352 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 02:48:49.943352 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 02:48:49.943352 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 02:48:49.943352 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 02:48:49.943352 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 02:48:49.943352 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 02:48:49.943352 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 02:48:49.943352 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9919dd32-c9e0-42ae-8981-414c2e663e73 could not be found. Aug 09 02:48:49.943352 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:48:49.943352 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:48:49.943352 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:48:49.943352 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:48:49.943352 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:48:49.943352 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:48:49.943352 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 02:48:49.943352 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 02:48:49.943352 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 02:48:49.944633 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 02:48:49.944633 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 02:48:49.944633 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 02:48:49.944633 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 02:48:49.944633 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 02:48:49.944633 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 02:48:49.944633 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 02:48:49.944633 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9919dd32-c9e0-42ae-8981-414c2e663e73 could not be found. Aug 09 02:48:49.944633 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:48:49.944633 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:48:49.944633 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:48:49.944633 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:48:49.944633 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:48:49.944633 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:48:49.944633 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 02:48:49.944633 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 02:48:49.944633 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9919dd32-c9e0-42ae-8981-414c2e663e73 could not be found. Aug 09 02:48:49.944633 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:48:49.946425 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-d8aeaba6-66a5-4258-9315-191d1d2c61d8 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] Returning 404 to user: Instance 9919dd32-c9e0-42ae-8981-414c2e663e73 could not be found. {{(pid=124425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 02:48:49.946425 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-d8aeaba6-66a5-4258-9315-191d1d2c61d8 tempest-AttachVolumeShelveTestJSON-1993749218 tempest-AttachVolumeShelveTestJSON-1993749218-project] 10.222.0.20 "GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73" status: 404 len: 111 microversion: 2.20 time: 0.031441 Aug 09 02:48:49.946425 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 488/1006] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 9 02:48:49 2022] GET /compute/v2.1/servers/9919dd32-c9e0-42ae-8981-414c2e663e73 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 02:49:06.255566 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 02:49:06.256124 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Tue Aug 9 02:49:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 02:49:27.787387 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-634203b6-0d4d-4038-85c9-832e919b38da tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-750393293", "imageRef": "04a06944-b2a8-4a65-b2a6-7ed3ff18a627", "flavorRef": "452", "networks": [{"uuid": "d2e316d6-3805-4f31-91b7-9728f7291478"}]}} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:49:27.796448 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:49:27.797075 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_cell1:SELECT=2 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:49:27.844447 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.network.neutron [None req-634203b6-0d4d-4038-85c9-832e919b38da tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] validate_networks() for [('d2e316d6-3805-4f31-91b7-9728f7291478', None, None, None, None, None)] {{(pid=124427) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 02:49:28.463558 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.virt.hardware [None req-634203b6-0d4d-4038-85c9-832e919b38da tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Flavor limits 0:0:0 {{(pid=124427) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 02:49:28.464099 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.virt.hardware [None req-634203b6-0d4d-4038-85c9-832e919b38da tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Image limits 0:0:0 {{(pid=124427) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 02:49:28.464664 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.virt.hardware [None req-634203b6-0d4d-4038-85c9-832e919b38da tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Flavor pref 0:0:0 {{(pid=124427) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 02:49:28.465112 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.virt.hardware [None req-634203b6-0d4d-4038-85c9-832e919b38da tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Image pref 0:0:0 {{(pid=124427) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 02:49:28.465589 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.virt.hardware [None req-634203b6-0d4d-4038-85c9-832e919b38da tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124427) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 02:49:28.475017 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-634203b6-0d4d-4038-85c9-832e919b38da tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:49:28.475777 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-634203b6-0d4d-4038-85c9-832e919b38da tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:49:28.476234 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-634203b6-0d4d-4038-85c9-832e919b38da tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:49:28.476945 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-634203b6-0d4d-4038-85c9-832e919b38da tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:49:28.477391 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-634203b6-0d4d-4038-85c9-832e919b38da tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:49:28.477391 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-634203b6-0d4d-4038-85c9-832e919b38da tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:49:28.498419 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.quota [None req-634203b6-0d4d-4038-85c9-832e919b38da tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Getting quotas for project 1ac907637c064b2499900b106ea18ab0. Resources: {'cores', 'ram', 'instances'} {{(pid=124427) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 02:49:28.503114 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.quota [None req-634203b6-0d4d-4038-85c9-832e919b38da tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Getting quotas for user 49614df61d1e4c4ebe333db2017e9636 and project 1ac907637c064b2499900b106ea18ab0. Resources: {'cores', 'ram', 'instances'} {{(pid=124427) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 02:49:28.514813 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-634203b6-0d4d-4038-85c9-832e919b38da tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Going to run 1 instances... {{(pid=124427) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 02:49:28.517105 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-634203b6-0d4d-4038-85c9-832e919b38da tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] [instance: e28968d3-d786-4fc1-9237-0460cb65c47c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='04a06944-b2a8-4a65-b2a6-7ed3ff18a627',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124427) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 02:49:28.563971 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-634203b6-0d4d-4038-85c9-832e919b38da tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.780639 Aug 09 02:49:28.564808 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 519/1007] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Aug 9 02:49:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 02:49:28.576020 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-8f946f91-be45-4bc3-b64c-71f22a94764c tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:49:28.576749 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-8f946f91-be45-4bc3-b64c-71f22a94764c tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] [instance: e28968d3-d786-4fc1-9237-0460cb65c47c] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:49:28.579614 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:49:28.580986 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:49:28.650041 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-8f946f91-be45-4bc3-b64c-71f22a94764c tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49614df61d1e4c4ebe333db2017e9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac907637c064b2499900b106ea18ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:49:28.659244 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-8f946f91-be45-4bc3-b64c-71f22a94764c tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] 10.222.0.20 "GET /compute/v2.1/servers/e28968d3-d786-4fc1-9237-0460cb65c47c" status: 200 len: 1213 microversion: 2.1 time: 0.087091 Aug 09 02:49:28.662616 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 489/1008] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:49:28 2022] GET /compute/v2.1/servers/e28968d3-d786-4fc1-9237-0460cb65c47c => generated 1213 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:49:29.680652 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-63cf3ca6-7a6f-43fa-bb32-d9ac70ac0ba5 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:49:29.681548 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-63cf3ca6-7a6f-43fa-bb32-d9ac70ac0ba5 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] [instance: e28968d3-d786-4fc1-9237-0460cb65c47c] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:49:29.688932 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-63cf3ca6-7a6f-43fa-bb32-d9ac70ac0ba5 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:49:29.689291 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-63cf3ca6-7a6f-43fa-bb32-d9ac70ac0ba5 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:49:29.689742 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-63cf3ca6-7a6f-43fa-bb32-d9ac70ac0ba5 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:49:29.690464 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-63cf3ca6-7a6f-43fa-bb32-d9ac70ac0ba5 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:49:29.691032 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-63cf3ca6-7a6f-43fa-bb32-d9ac70ac0ba5 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:49:29.691452 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-63cf3ca6-7a6f-43fa-bb32-d9ac70ac0ba5 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:49:29.774456 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-63cf3ca6-7a6f-43fa-bb32-d9ac70ac0ba5 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49614df61d1e4c4ebe333db2017e9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac907637c064b2499900b106ea18ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:49:29.782913 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-63cf3ca6-7a6f-43fa-bb32-d9ac70ac0ba5 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] 10.222.0.20 "GET /compute/v2.1/servers/e28968d3-d786-4fc1-9237-0460cb65c47c" status: 200 len: 1283 microversion: 2.1 time: 0.106683 Aug 09 02:49:29.783511 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 520/1009] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:49:29 2022] GET /compute/v2.1/servers/e28968d3-d786-4fc1-9237-0460cb65c47c => generated 1283 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:49:30.803872 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-a2075215-6129-44fb-aa65-d5700d7f2d14 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:49:30.804607 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-a2075215-6129-44fb-aa65-d5700d7f2d14 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] [instance: e28968d3-d786-4fc1-9237-0460cb65c47c] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:49:30.812221 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a2075215-6129-44fb-aa65-d5700d7f2d14 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:49:30.812680 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a2075215-6129-44fb-aa65-d5700d7f2d14 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:49:30.813336 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a2075215-6129-44fb-aa65-d5700d7f2d14 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:49:30.814026 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a2075215-6129-44fb-aa65-d5700d7f2d14 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:49:30.814505 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a2075215-6129-44fb-aa65-d5700d7f2d14 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:49:30.814898 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-a2075215-6129-44fb-aa65-d5700d7f2d14 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:49:31.016450 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [req-ba21df4b-c98c-44e7-b2b1-36a647876d55 req-6da75f27-df90-46ad-b16f-83b03922b377 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e28968d3-d786-4fc1-9237-0460cb65c47c", "tag": "595fe7f0-3163-4e61-b997-3ee5ff67d67c"}]} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:49:31.023022 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-a2075215-6129-44fb-aa65-d5700d7f2d14 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49614df61d1e4c4ebe333db2017e9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac907637c064b2499900b106ea18ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:49:31.027772 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-ba21df4b-c98c-44e7-b2b1-36a647876d55 req-6da75f27-df90-46ad-b16f-83b03922b377 service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:49:31.028626 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-ba21df4b-c98c-44e7-b2b1-36a647876d55 req-6da75f27-df90-46ad-b16f-83b03922b377 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:49:31.029056 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-ba21df4b-c98c-44e7-b2b1-36a647876d55 req-6da75f27-df90-46ad-b16f-83b03922b377 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:49:31.034686 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-a2075215-6129-44fb-aa65-d5700d7f2d14 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] 10.222.0.20 "GET /compute/v2.1/servers/e28968d3-d786-4fc1-9237-0460cb65c47c" status: 200 len: 1313 microversion: 2.1 time: 0.234658 Aug 09 02:49:31.035381 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 490/1010] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:49:30 2022] GET /compute/v2.1/servers/e28968d3-d786-4fc1-9237-0460cb65c47c => generated 1313 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:49:31.040795 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.compute.server_external_events [req-ba21df4b-c98c-44e7-b2b1-36a647876d55 req-6da75f27-df90-46ad-b16f-83b03922b377 service nova] Creating event network-changed:595fe7f0-3163-4e61-b997-3ee5ff67d67c for instance e28968d3-d786-4fc1-9237-0460cb65c47c on hv-cinder-85246 Aug 09 02:49:31.045916 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [req-ba21df4b-c98c-44e7-b2b1-36a647876d55 req-6da75f27-df90-46ad-b16f-83b03922b377 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033473 Aug 09 02:49:31.046591 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 521/1011] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:49:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:49:32.056273 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-de6d3a96-9303-47f0-a325-9a997fc0dce3 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:49:32.056872 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-de6d3a96-9303-47f0-a325-9a997fc0dce3 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] [instance: e28968d3-d786-4fc1-9237-0460cb65c47c] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:49:32.063727 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-de6d3a96-9303-47f0-a325-9a997fc0dce3 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:49:32.064212 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-de6d3a96-9303-47f0-a325-9a997fc0dce3 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:49:32.064667 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-de6d3a96-9303-47f0-a325-9a997fc0dce3 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:49:32.065351 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-de6d3a96-9303-47f0-a325-9a997fc0dce3 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:49:32.065804 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-de6d3a96-9303-47f0-a325-9a997fc0dce3 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:49:32.066241 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-de6d3a96-9303-47f0-a325-9a997fc0dce3 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:49:32.204388 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-de6d3a96-9303-47f0-a325-9a997fc0dce3 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49614df61d1e4c4ebe333db2017e9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac907637c064b2499900b106ea18ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:49:32.213346 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-de6d3a96-9303-47f0-a325-9a997fc0dce3 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] 10.222.0.20 "GET /compute/v2.1/servers/e28968d3-d786-4fc1-9237-0460cb65c47c" status: 200 len: 1313 microversion: 2.1 time: 0.161022 Aug 09 02:49:32.213959 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 491/1012] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:49:32 2022] GET /compute/v2.1/servers/e28968d3-d786-4fc1-9237-0460cb65c47c => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:49:33.240908 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-4e1ba8f0-09a5-4bbc-acea-edbb594e9a28 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:49:33.241964 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-4e1ba8f0-09a5-4bbc-acea-edbb594e9a28 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] [instance: e28968d3-d786-4fc1-9237-0460cb65c47c] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:49:33.252560 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4e1ba8f0-09a5-4bbc-acea-edbb594e9a28 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:49:33.253316 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4e1ba8f0-09a5-4bbc-acea-edbb594e9a28 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:49:33.254133 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4e1ba8f0-09a5-4bbc-acea-edbb594e9a28 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:49:33.255305 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4e1ba8f0-09a5-4bbc-acea-edbb594e9a28 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:49:33.256054 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4e1ba8f0-09a5-4bbc-acea-edbb594e9a28 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:49:33.256812 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4e1ba8f0-09a5-4bbc-acea-edbb594e9a28 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:49:33.405654 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-4e1ba8f0-09a5-4bbc-acea-edbb594e9a28 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49614df61d1e4c4ebe333db2017e9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac907637c064b2499900b106ea18ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:49:33.413662 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-4e1ba8f0-09a5-4bbc-acea-edbb594e9a28 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] 10.222.0.20 "GET /compute/v2.1/servers/e28968d3-d786-4fc1-9237-0460cb65c47c" status: 200 len: 1313 microversion: 2.1 time: 0.181262 Aug 09 02:49:33.414254 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 522/1013] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:49:33 2022] GET /compute/v2.1/servers/e28968d3-d786-4fc1-9237-0460cb65c47c => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:49:34.436776 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-c19f7b11-d272-447f-b8ce-80dccadad064 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:49:34.437393 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-c19f7b11-d272-447f-b8ce-80dccadad064 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] [instance: e28968d3-d786-4fc1-9237-0460cb65c47c] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:49:34.444297 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c19f7b11-d272-447f-b8ce-80dccadad064 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:49:34.444792 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c19f7b11-d272-447f-b8ce-80dccadad064 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:49:34.445221 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c19f7b11-d272-447f-b8ce-80dccadad064 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:49:34.445918 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c19f7b11-d272-447f-b8ce-80dccadad064 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:49:34.446428 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c19f7b11-d272-447f-b8ce-80dccadad064 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:49:34.446853 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-c19f7b11-d272-447f-b8ce-80dccadad064 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:49:34.581605 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-c19f7b11-d272-447f-b8ce-80dccadad064 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49614df61d1e4c4ebe333db2017e9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac907637c064b2499900b106ea18ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:49:34.589586 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-c19f7b11-d272-447f-b8ce-80dccadad064 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] 10.222.0.20 "GET /compute/v2.1/servers/e28968d3-d786-4fc1-9237-0460cb65c47c" status: 200 len: 1313 microversion: 2.1 time: 0.157813 Aug 09 02:49:34.590147 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 492/1014] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:49:34 2022] GET /compute/v2.1/servers/e28968d3-d786-4fc1-9237-0460cb65c47c => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:49:35.614803 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-992e7f87-a2e3-46dd-a798-de4ba094351a tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:49:35.616028 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-992e7f87-a2e3-46dd-a798-de4ba094351a tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] [instance: e28968d3-d786-4fc1-9237-0460cb65c47c] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:49:35.626067 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-992e7f87-a2e3-46dd-a798-de4ba094351a tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:49:35.626837 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-992e7f87-a2e3-46dd-a798-de4ba094351a tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:49:35.627512 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-992e7f87-a2e3-46dd-a798-de4ba094351a tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:49:35.628573 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-992e7f87-a2e3-46dd-a798-de4ba094351a tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:49:35.629276 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-992e7f87-a2e3-46dd-a798-de4ba094351a tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:49:35.629954 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-992e7f87-a2e3-46dd-a798-de4ba094351a tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:49:35.763511 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-992e7f87-a2e3-46dd-a798-de4ba094351a tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49614df61d1e4c4ebe333db2017e9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac907637c064b2499900b106ea18ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:49:35.771513 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-992e7f87-a2e3-46dd-a798-de4ba094351a tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] 10.222.0.20 "GET /compute/v2.1/servers/e28968d3-d786-4fc1-9237-0460cb65c47c" status: 200 len: 1313 microversion: 2.1 time: 0.163644 Aug 09 02:49:35.772054 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 523/1015] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:49:35 2022] GET /compute/v2.1/servers/e28968d3-d786-4fc1-9237-0460cb65c47c => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:49:36.795675 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-9f1eca15-455e-4e00-9f0e-b80036db8464 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:49:36.796259 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-9f1eca15-455e-4e00-9f0e-b80036db8464 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] [instance: e28968d3-d786-4fc1-9237-0460cb65c47c] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:49:36.803223 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9f1eca15-455e-4e00-9f0e-b80036db8464 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:49:36.803727 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9f1eca15-455e-4e00-9f0e-b80036db8464 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:49:36.804158 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9f1eca15-455e-4e00-9f0e-b80036db8464 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:49:36.804843 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9f1eca15-455e-4e00-9f0e-b80036db8464 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:49:36.805288 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9f1eca15-455e-4e00-9f0e-b80036db8464 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:49:36.805701 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-9f1eca15-455e-4e00-9f0e-b80036db8464 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:49:36.941379 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-9f1eca15-455e-4e00-9f0e-b80036db8464 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49614df61d1e4c4ebe333db2017e9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac907637c064b2499900b106ea18ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:49:36.949538 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-9f1eca15-455e-4e00-9f0e-b80036db8464 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] 10.222.0.20 "GET /compute/v2.1/servers/e28968d3-d786-4fc1-9237-0460cb65c47c" status: 200 len: 1313 microversion: 2.1 time: 0.159460 Aug 09 02:49:36.950168 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 493/1016] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:49:36 2022] GET /compute/v2.1/servers/e28968d3-d786-4fc1-9237-0460cb65c47c => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:49:37.406415 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [req-9d279242-e9ee-46a5-a204-7e51bba3d943 req-c5acca03-7a1c-4c97-8b50-9f4ce3beb95b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e28968d3-d786-4fc1-9237-0460cb65c47c", "name": "network-vif-plugged", "status": "completed", "tag": "595fe7f0-3163-4e61-b997-3ee5ff67d67c"}]} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:49:37.418123 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-9d279242-e9ee-46a5-a204-7e51bba3d943 req-c5acca03-7a1c-4c97-8b50-9f4ce3beb95b service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:49:37.418696 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-9d279242-e9ee-46a5-a204-7e51bba3d943 req-c5acca03-7a1c-4c97-8b50-9f4ce3beb95b service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:49:37.419146 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-9d279242-e9ee-46a5-a204-7e51bba3d943 req-c5acca03-7a1c-4c97-8b50-9f4ce3beb95b service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:49:37.430853 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.compute.server_external_events [req-9d279242-e9ee-46a5-a204-7e51bba3d943 req-c5acca03-7a1c-4c97-8b50-9f4ce3beb95b service nova] Creating event network-vif-plugged:595fe7f0-3163-4e61-b997-3ee5ff67d67c for instance e28968d3-d786-4fc1-9237-0460cb65c47c on hv-cinder-85246 Aug 09 02:49:37.435960 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [req-9d279242-e9ee-46a5-a204-7e51bba3d943 req-c5acca03-7a1c-4c97-8b50-9f4ce3beb95b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033644 Aug 09 02:49:37.436562 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 524/1017] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:49:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:49:37.981416 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-d0b466fe-cb7e-4e31-86c9-e629abdbc71d tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:49:37.982409 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-d0b466fe-cb7e-4e31-86c9-e629abdbc71d tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] [instance: e28968d3-d786-4fc1-9237-0460cb65c47c] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:49:37.993985 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d0b466fe-cb7e-4e31-86c9-e629abdbc71d tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:49:37.994920 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d0b466fe-cb7e-4e31-86c9-e629abdbc71d tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:49:37.995630 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d0b466fe-cb7e-4e31-86c9-e629abdbc71d tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:49:37.996741 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d0b466fe-cb7e-4e31-86c9-e629abdbc71d tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:49:37.997188 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d0b466fe-cb7e-4e31-86c9-e629abdbc71d tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:49:37.997607 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d0b466fe-cb7e-4e31-86c9-e629abdbc71d tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:49:38.135171 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-d0b466fe-cb7e-4e31-86c9-e629abdbc71d tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49614df61d1e4c4ebe333db2017e9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac907637c064b2499900b106ea18ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:49:38.142670 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-d0b466fe-cb7e-4e31-86c9-e629abdbc71d tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] 10.222.0.20 "GET /compute/v2.1/servers/e28968d3-d786-4fc1-9237-0460cb65c47c" status: 200 len: 1313 microversion: 2.1 time: 0.167943 Aug 09 02:49:38.143241 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 494/1018] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:49:37 2022] GET /compute/v2.1/servers/e28968d3-d786-4fc1-9237-0460cb65c47c => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:49:39.161680 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_cell0:SELECT=2 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:49:39.162579 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_cell0:SELECT=6 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:49:39.166828 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-9c6f7d27-67f5-41e4-9186-c4ea80d253aa tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:49:39.167584 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-9c6f7d27-67f5-41e4-9186-c4ea80d253aa tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] [instance: e28968d3-d786-4fc1-9237-0460cb65c47c] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:49:39.175177 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9c6f7d27-67f5-41e4-9186-c4ea80d253aa tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:49:39.175660 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9c6f7d27-67f5-41e4-9186-c4ea80d253aa tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:49:39.176094 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9c6f7d27-67f5-41e4-9186-c4ea80d253aa tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:49:39.176795 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9c6f7d27-67f5-41e4-9186-c4ea80d253aa tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:49:39.177289 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9c6f7d27-67f5-41e4-9186-c4ea80d253aa tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:49:39.177722 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9c6f7d27-67f5-41e4-9186-c4ea80d253aa tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:49:39.311307 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-9c6f7d27-67f5-41e4-9186-c4ea80d253aa tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49614df61d1e4c4ebe333db2017e9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac907637c064b2499900b106ea18ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:49:39.319373 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-9c6f7d27-67f5-41e4-9186-c4ea80d253aa tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] 10.222.0.20 "GET /compute/v2.1/servers/e28968d3-d786-4fc1-9237-0460cb65c47c" status: 200 len: 1497 microversion: 2.1 time: 0.159122 Aug 09 02:49:39.319939 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 525/1019] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:49:39 2022] GET /compute/v2.1/servers/e28968d3-d786-4fc1-9237-0460cb65c47c => generated 1497 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:49:39.836786 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-ffc4164b-caa2-4d0c-8171-523062216a52 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:49:39.837309 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-ffc4164b-caa2-4d0c-8171-523062216a52 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] [instance: e28968d3-d786-4fc1-9237-0460cb65c47c] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:49:39.839273 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_cell0:SELECT=2 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:49:39.845405 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ffc4164b-caa2-4d0c-8171-523062216a52 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:49:39.845875 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ffc4164b-caa2-4d0c-8171-523062216a52 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:49:39.846342 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ffc4164b-caa2-4d0c-8171-523062216a52 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:49:39.847022 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ffc4164b-caa2-4d0c-8171-523062216a52 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:49:39.847463 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ffc4164b-caa2-4d0c-8171-523062216a52 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:49:39.847874 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ffc4164b-caa2-4d0c-8171-523062216a52 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:49:39.873671 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-ffc4164b-caa2-4d0c-8171-523062216a52 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] [instance: e28968d3-d786-4fc1-9237-0460cb65c47c] Going to try to terminate instance {{(pid=124425) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 02:49:39.957653 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-ffc4164b-caa2-4d0c-8171-523062216a52 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e28968d3-d786-4fc1-9237-0460cb65c47c" status: 204 len: 0 microversion: 2.1 time: 0.124463 Aug 09 02:49:39.958503 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 495/1020] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 9 02:49:39 2022] DELETE /compute/v2.1/servers/e28968d3-d786-4fc1-9237-0460cb65c47c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 02:49:39.968577 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-b7ad5e6c-d476-44e7-8880-28f75ea9064e tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:49:39.969294 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-b7ad5e6c-d476-44e7-8880-28f75ea9064e tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] [instance: e28968d3-d786-4fc1-9237-0460cb65c47c] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:49:39.976428 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b7ad5e6c-d476-44e7-8880-28f75ea9064e tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:49:39.977099 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b7ad5e6c-d476-44e7-8880-28f75ea9064e tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:49:39.977533 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b7ad5e6c-d476-44e7-8880-28f75ea9064e tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:49:39.978264 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b7ad5e6c-d476-44e7-8880-28f75ea9064e tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:49:39.978711 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b7ad5e6c-d476-44e7-8880-28f75ea9064e tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:49:39.979158 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-b7ad5e6c-d476-44e7-8880-28f75ea9064e tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:49:40.109632 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-b7ad5e6c-d476-44e7-8880-28f75ea9064e tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49614df61d1e4c4ebe333db2017e9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac907637c064b2499900b106ea18ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:49:40.117670 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-b7ad5e6c-d476-44e7-8880-28f75ea9064e tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] 10.222.0.20 "GET /compute/v2.1/servers/e28968d3-d786-4fc1-9237-0460cb65c47c" status: 200 len: 1503 microversion: 2.1 time: 0.154270 Aug 09 02:49:40.118260 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 526/1021] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:49:39 2022] GET /compute/v2.1/servers/e28968d3-d786-4fc1-9237-0460cb65c47c => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:49:41.144088 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-e6e169b7-f2c7-4038-a3a9-9671cf2cc120 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:49:41.145282 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-e6e169b7-f2c7-4038-a3a9-9671cf2cc120 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] [instance: e28968d3-d786-4fc1-9237-0460cb65c47c] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:49:41.155984 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e6e169b7-f2c7-4038-a3a9-9671cf2cc120 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:49:41.156777 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e6e169b7-f2c7-4038-a3a9-9671cf2cc120 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:49:41.157556 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e6e169b7-f2c7-4038-a3a9-9671cf2cc120 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:49:41.158285 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e6e169b7-f2c7-4038-a3a9-9671cf2cc120 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:49:41.158733 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e6e169b7-f2c7-4038-a3a9-9671cf2cc120 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:49:41.159159 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e6e169b7-f2c7-4038-a3a9-9671cf2cc120 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:49:41.306838 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-e6e169b7-f2c7-4038-a3a9-9671cf2cc120 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49614df61d1e4c4ebe333db2017e9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac907637c064b2499900b106ea18ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:49:41.314797 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-e6e169b7-f2c7-4038-a3a9-9671cf2cc120 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] 10.222.0.20 "GET /compute/v2.1/servers/e28968d3-d786-4fc1-9237-0460cb65c47c" status: 200 len: 1503 microversion: 2.1 time: 0.177989 Aug 09 02:49:41.315377 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 496/1022] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:49:41 2022] GET /compute/v2.1/servers/e28968d3-d786-4fc1-9237-0460cb65c47c => generated 1503 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:49:42.062791 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [req-bd84ccde-7733-409c-bba4-664c63652fb9 req-931f63b2-ffdc-4c58-bd71-9a43d0165a5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e28968d3-d786-4fc1-9237-0460cb65c47c", "name": "network-vif-deleted", "tag": "595fe7f0-3163-4e61-b997-3ee5ff67d67c"}]} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:49:42.073570 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-bd84ccde-7733-409c-bba4-664c63652fb9 req-931f63b2-ffdc-4c58-bd71-9a43d0165a5c service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:49:42.074044 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-bd84ccde-7733-409c-bba4-664c63652fb9 req-931f63b2-ffdc-4c58-bd71-9a43d0165a5c service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:49:42.074501 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-bd84ccde-7733-409c-bba4-664c63652fb9 req-931f63b2-ffdc-4c58-bd71-9a43d0165a5c service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:49:42.085949 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.compute.server_external_events [req-bd84ccde-7733-409c-bba4-664c63652fb9 req-931f63b2-ffdc-4c58-bd71-9a43d0165a5c service nova] Creating event network-vif-deleted:595fe7f0-3163-4e61-b997-3ee5ff67d67c for instance e28968d3-d786-4fc1-9237-0460cb65c47c on hv-cinder-85246 Aug 09 02:49:42.090961 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [req-bd84ccde-7733-409c-bba4-664c63652fb9 req-931f63b2-ffdc-4c58-bd71-9a43d0165a5c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031643 Aug 09 02:49:42.091569 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 527/1023] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:49:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:49:42.336164 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-1c197ff5-9997-450e-81d5-dbdaedc81883 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:49:42.336738 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-1c197ff5-9997-450e-81d5-dbdaedc81883 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] [instance: e28968d3-d786-4fc1-9237-0460cb65c47c] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:49:42.343605 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1c197ff5-9997-450e-81d5-dbdaedc81883 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:49:42.344093 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1c197ff5-9997-450e-81d5-dbdaedc81883 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:49:42.344518 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1c197ff5-9997-450e-81d5-dbdaedc81883 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:49:42.345301 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1c197ff5-9997-450e-81d5-dbdaedc81883 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:49:42.345752 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1c197ff5-9997-450e-81d5-dbdaedc81883 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:49:42.346182 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1c197ff5-9997-450e-81d5-dbdaedc81883 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:49:42.377348 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1c197ff5-9997-450e-81d5-dbdaedc81883 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:49:42.377821 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1c197ff5-9997-450e-81d5-dbdaedc81883 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:49:42.378290 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1c197ff5-9997-450e-81d5-dbdaedc81883 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:49:42.378728 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.objects.instance [None req-1c197ff5-9997-450e-81d5-dbdaedc81883 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lazy-loading 'fault' on Instance uuid e28968d3-d786-4fc1-9237-0460cb65c47c {{(pid=124425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 02:49:42.421667 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-1c197ff5-9997-450e-81d5-dbdaedc81883 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49614df61d1e4c4ebe333db2017e9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac907637c064b2499900b106ea18ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:49:42.429456 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-1c197ff5-9997-450e-81d5-dbdaedc81883 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] 10.222.0.20 "GET /compute/v2.1/servers/e28968d3-d786-4fc1-9237-0460cb65c47c" status: 200 len: 1303 microversion: 2.1 time: 0.097310 Aug 09 02:49:42.430028 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 497/1024] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:49:42 2022] GET /compute/v2.1/servers/e28968d3-d786-4fc1-9237-0460cb65c47c => generated 1303 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:49:43.451781 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-2f142b1f-f82e-44b9-8d8c-054fd2e86868 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:49:43.452556 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-2f142b1f-f82e-44b9-8d8c-054fd2e86868 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] [instance: e28968d3-d786-4fc1-9237-0460cb65c47c] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:49:43.459536 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2f142b1f-f82e-44b9-8d8c-054fd2e86868 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:49:43.459997 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2f142b1f-f82e-44b9-8d8c-054fd2e86868 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:49:43.460502 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2f142b1f-f82e-44b9-8d8c-054fd2e86868 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:49:43.461273 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2f142b1f-f82e-44b9-8d8c-054fd2e86868 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:49:43.461812 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2f142b1f-f82e-44b9-8d8c-054fd2e86868 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:49:43.462233 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-2f142b1f-f82e-44b9-8d8c-054fd2e86868 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:49:43.476152 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.wsgi [None req-2f142b1f-f82e-44b9-8d8c-054fd2e86868 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] HTTP exception thrown: Instance e28968d3-d786-4fc1-9237-0460cb65c47c could not be found. Aug 09 02:49:43.477822 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-2f142b1f-f82e-44b9-8d8c-054fd2e86868 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Request method failure captured: Aug 09 02:49:43.477822 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: request: GET /compute/v2.1/servers/e28968d3-d786-4fc1-9237-0460cb65c47c HTTP/1.1 Aug 09 02:49:43.477822 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Accept: application/json Aug 09 02:49:43.477822 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Accept-Encoding: identity Aug 09 02:49:43.477822 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Connection: close Aug 09 02:49:43.477822 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Content-Length: 0 Aug 09 02:49:43.477822 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Content-Type: application/json Aug 09 02:49:43.477822 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Host: 10.222.0.20 Aug 09 02:49:43.477822 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Openstack-System-Scope: None Aug 09 02:49:43.477822 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: User-Agent: python-urllib3/1.26.11 Aug 09 02:49:43.477822 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Auth-Token: gAAAAABi8cs2HsEmfJIfffHPUtK0oCt_iIkRxbLOqIOoB8qOm1KfmVX8EzlPD4-aGteZyt7pWZ5XvEpjKNcqUts28uO2lkUu73RrUSC5XXCmrTVmoYECGSzutTEdpRNZ8dwdhrcr44Qud499kWmsowgxJ_KHP32jIt9999IQ3H5rpgrtSOIPtxE Aug 09 02:49:43.477822 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Domain-Id: None Aug 09 02:49:43.477822 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Domain-Name: None Aug 09 02:49:43.477822 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Identity-Status: Confirmed Aug 09 02:49:43.477822 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Is-Admin-Project: True Aug 09 02:49:43.477822 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Domain-Id: default Aug 09 02:49:43.477822 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Domain-Name: Default Aug 09 02:49:43.477822 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Id: 1ac907637c064b2499900b106ea18ab0 Aug 09 02:49:43.477822 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Name: tempest-VolumesActionsTest-1907156629 Aug 09 02:49:43.477822 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Role: reader,member Aug 09 02:49:43.477822 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Roles: reader,member Aug 09 02:49:43.479550 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1ac907637c064b2499900b106ea18ab0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1ac907637c064b2499900b106ea18ab0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1ac907637c064b2499900b106ea18ab0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1ac907637c064b2499900b106ea18ab0"}]}] Aug 09 02:49:43.479550 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant: tempest-VolumesActionsTest-1907156629 Aug 09 02:49:43.479550 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant-Id: 1ac907637c064b2499900b106ea18ab0 Aug 09 02:49:43.479550 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant-Name: tempest-VolumesActionsTest-1907156629 Aug 09 02:49:43.479550 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User: tempest-VolumesActionsTest-1907156629-project Aug 09 02:49:43.479550 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Domain-Id: default Aug 09 02:49:43.479550 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Domain-Name: Default Aug 09 02:49:43.479550 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Id: 49614df61d1e4c4ebe333db2017e9636 Aug 09 02:49:43.479550 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Name: tempest-VolumesActionsTest-1907156629-project Aug 09 02:49:43.479550 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: method: > Aug 09 02:49:43.479550 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: exception: Instance e28968d3-d786-4fc1-9237-0460cb65c47c could not be found. Aug 09 02:49:43.479550 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: action_args: {'id': 'e28968d3-d786-4fc1-9237-0460cb65c47c'} Aug 09 02:49:43.480751 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 02:49:43.480751 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:49:43.480751 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 02:49:43.480751 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 02:49:43.480751 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 02:49:43.480751 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 02:49:43.480751 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 02:49:43.480751 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 02:49:43.480751 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 02:49:43.480751 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 02:49:43.480751 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e28968d3-d786-4fc1-9237-0460cb65c47c could not be found. Aug 09 02:49:43.480751 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:49:43.480751 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:49:43.480751 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:49:43.480751 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:49:43.480751 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:49:43.480751 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:49:43.480751 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 02:49:43.480751 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 02:49:43.480751 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 02:49:43.482134 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 02:49:43.482134 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 02:49:43.482134 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 02:49:43.482134 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 02:49:43.482134 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 02:49:43.482134 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 02:49:43.482134 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 02:49:43.482134 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e28968d3-d786-4fc1-9237-0460cb65c47c could not be found. Aug 09 02:49:43.482134 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:49:43.482134 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:49:43.482134 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:49:43.482134 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:49:43.482134 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:49:43.482134 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:49:43.482134 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 02:49:43.482134 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 02:49:43.482134 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e28968d3-d786-4fc1-9237-0460cb65c47c could not be found. Aug 09 02:49:43.482134 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:49:43.483410 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-2f142b1f-f82e-44b9-8d8c-054fd2e86868 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Returning 404 to user: Instance e28968d3-d786-4fc1-9237-0460cb65c47c could not be found. {{(pid=124427) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 02:49:43.483410 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-2f142b1f-f82e-44b9-8d8c-054fd2e86868 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] 10.222.0.20 "GET /compute/v2.1/servers/e28968d3-d786-4fc1-9237-0460cb65c47c" status: 404 len: 111 microversion: 2.1 time: 0.032369 Aug 09 02:49:43.483410 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 528/1025] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:49:43 2022] GET /compute/v2.1/servers/e28968d3-d786-4fc1-9237-0460cb65c47c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 02:49:43.580954 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-53c87f70-4091-4cec-9707-100063e20002 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1955411671", "imageRef": "04a06944-b2a8-4a65-b2a6-7ed3ff18a627", "flavorRef": "452", "networks": [{"uuid": "d2e316d6-3805-4f31-91b7-9728f7291478"}]}} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:49:43.634373 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.network.neutron [None req-53c87f70-4091-4cec-9707-100063e20002 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] validate_networks() for [('d2e316d6-3805-4f31-91b7-9728f7291478', None, None, None, None, None)] {{(pid=124425) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 02:49:44.008330 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.virt.hardware [None req-53c87f70-4091-4cec-9707-100063e20002 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Flavor limits 0:0:0 {{(pid=124425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 02:49:44.008781 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.virt.hardware [None req-53c87f70-4091-4cec-9707-100063e20002 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Image limits 0:0:0 {{(pid=124425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 02:49:44.009268 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.virt.hardware [None req-53c87f70-4091-4cec-9707-100063e20002 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Flavor pref 0:0:0 {{(pid=124425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 02:49:44.009675 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.virt.hardware [None req-53c87f70-4091-4cec-9707-100063e20002 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Image pref 0:0:0 {{(pid=124425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 02:49:44.010075 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.virt.hardware [None req-53c87f70-4091-4cec-9707-100063e20002 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 02:49:44.020577 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-53c87f70-4091-4cec-9707-100063e20002 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:49:44.021036 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-53c87f70-4091-4cec-9707-100063e20002 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:49:44.021470 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-53c87f70-4091-4cec-9707-100063e20002 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:49:44.022198 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-53c87f70-4091-4cec-9707-100063e20002 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:49:44.022674 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-53c87f70-4091-4cec-9707-100063e20002 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:49:44.023091 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-53c87f70-4091-4cec-9707-100063e20002 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:49:44.040296 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.quota [None req-53c87f70-4091-4cec-9707-100063e20002 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Getting quotas for project 1ac907637c064b2499900b106ea18ab0. Resources: {'cores', 'ram', 'instances'} {{(pid=124425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 02:49:44.044656 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.quota [None req-53c87f70-4091-4cec-9707-100063e20002 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Getting quotas for user 49614df61d1e4c4ebe333db2017e9636 and project 1ac907637c064b2499900b106ea18ab0. Resources: {'cores', 'ram', 'instances'} {{(pid=124425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 02:49:44.056522 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-53c87f70-4091-4cec-9707-100063e20002 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Going to run 1 instances... {{(pid=124425) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 02:49:44.058800 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-53c87f70-4091-4cec-9707-100063e20002 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] [instance: 40063e8e-3745-414b-9fde-cd398bf23c3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='04a06944-b2a8-4a65-b2a6-7ed3ff18a627',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 02:49:44.106686 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-53c87f70-4091-4cec-9707-100063e20002 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.529573 Aug 09 02:49:44.107362 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 498/1026] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Aug 9 02:49:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 02:49:44.118646 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-c2744f49-4f24-40ff-a996-0f49a7b2abdc tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:49:44.119528 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-c2744f49-4f24-40ff-a996-0f49a7b2abdc tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] [instance: 40063e8e-3745-414b-9fde-cd398bf23c3b] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:49:44.171773 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-c2744f49-4f24-40ff-a996-0f49a7b2abdc tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49614df61d1e4c4ebe333db2017e9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac907637c064b2499900b106ea18ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:49:44.178625 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-c2744f49-4f24-40ff-a996-0f49a7b2abdc tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] 10.222.0.20 "GET /compute/v2.1/servers/40063e8e-3745-414b-9fde-cd398bf23c3b" status: 200 len: 1214 microversion: 2.1 time: 0.064038 Aug 09 02:49:44.179171 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 529/1027] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:49:44 2022] GET /compute/v2.1/servers/40063e8e-3745-414b-9fde-cd398bf23c3b => generated 1214 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:49:45.199806 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-bc38b7cf-2c20-43a4-be78-4d3100fbb121 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:49:45.200537 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-bc38b7cf-2c20-43a4-be78-4d3100fbb121 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] [instance: 40063e8e-3745-414b-9fde-cd398bf23c3b] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:49:45.207598 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-bc38b7cf-2c20-43a4-be78-4d3100fbb121 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:49:45.208122 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-bc38b7cf-2c20-43a4-be78-4d3100fbb121 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:49:45.208502 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-bc38b7cf-2c20-43a4-be78-4d3100fbb121 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:49:45.209343 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-bc38b7cf-2c20-43a4-be78-4d3100fbb121 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:49:45.209825 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-bc38b7cf-2c20-43a4-be78-4d3100fbb121 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:49:45.210275 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-bc38b7cf-2c20-43a4-be78-4d3100fbb121 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:49:45.287765 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-bc38b7cf-2c20-43a4-be78-4d3100fbb121 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49614df61d1e4c4ebe333db2017e9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac907637c064b2499900b106ea18ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:49:45.295485 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-bc38b7cf-2c20-43a4-be78-4d3100fbb121 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] 10.222.0.20 "GET /compute/v2.1/servers/40063e8e-3745-414b-9fde-cd398bf23c3b" status: 200 len: 1284 microversion: 2.1 time: 0.100356 Aug 09 02:49:45.296099 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 499/1028] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:49:45 2022] GET /compute/v2.1/servers/40063e8e-3745-414b-9fde-cd398bf23c3b => generated 1284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:49:46.316662 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-49433dc1-d9ff-4243-bb5b-5bc9505e17c5 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:49:46.317854 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-49433dc1-d9ff-4243-bb5b-5bc9505e17c5 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] [instance: 40063e8e-3745-414b-9fde-cd398bf23c3b] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:49:46.325644 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-49433dc1-d9ff-4243-bb5b-5bc9505e17c5 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:49:46.326128 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-49433dc1-d9ff-4243-bb5b-5bc9505e17c5 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:49:46.326600 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-49433dc1-d9ff-4243-bb5b-5bc9505e17c5 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:49:46.327284 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-49433dc1-d9ff-4243-bb5b-5bc9505e17c5 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:49:46.327742 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-49433dc1-d9ff-4243-bb5b-5bc9505e17c5 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:49:46.328161 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-49433dc1-d9ff-4243-bb5b-5bc9505e17c5 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:49:46.773569 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-49433dc1-d9ff-4243-bb5b-5bc9505e17c5 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49614df61d1e4c4ebe333db2017e9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac907637c064b2499900b106ea18ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:49:46.781539 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-49433dc1-d9ff-4243-bb5b-5bc9505e17c5 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] 10.222.0.20 "GET /compute/v2.1/servers/40063e8e-3745-414b-9fde-cd398bf23c3b" status: 200 len: 1314 microversion: 2.1 time: 0.468949 Aug 09 02:49:46.782114 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 530/1029] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:49:46 2022] GET /compute/v2.1/servers/40063e8e-3745-414b-9fde-cd398bf23c3b => generated 1314 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:49:46.789541 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [req-d248fc42-98fa-4c5e-a671-170f298f673d req-05f2d439-8f08-4e87-92c4-e45c6393b76a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40063e8e-3745-414b-9fde-cd398bf23c3b", "tag": "c2312952-14ae-432e-a8bf-79ca9f0d4844"}]} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:49:46.808205 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-d248fc42-98fa-4c5e-a671-170f298f673d req-05f2d439-8f08-4e87-92c4-e45c6393b76a service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:49:46.808681 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-d248fc42-98fa-4c5e-a671-170f298f673d req-05f2d439-8f08-4e87-92c4-e45c6393b76a service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:49:46.809105 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-d248fc42-98fa-4c5e-a671-170f298f673d req-05f2d439-8f08-4e87-92c4-e45c6393b76a service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:49:46.820468 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.compute.server_external_events [req-d248fc42-98fa-4c5e-a671-170f298f673d req-05f2d439-8f08-4e87-92c4-e45c6393b76a service nova] Creating event network-changed:c2312952-14ae-432e-a8bf-79ca9f0d4844 for instance 40063e8e-3745-414b-9fde-cd398bf23c3b on hv-cinder-85246 Aug 09 02:49:46.825302 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [req-d248fc42-98fa-4c5e-a671-170f298f673d req-05f2d439-8f08-4e87-92c4-e45c6393b76a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039495 Aug 09 02:49:46.825897 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 500/1030] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:49:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 02:49:47.808307 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-58a8173c-dbcf-48b9-807b-c8e176177690 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:49:47.809215 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-58a8173c-dbcf-48b9-807b-c8e176177690 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] [instance: 40063e8e-3745-414b-9fde-cd398bf23c3b] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:49:47.822050 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-58a8173c-dbcf-48b9-807b-c8e176177690 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:49:47.822569 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-58a8173c-dbcf-48b9-807b-c8e176177690 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:49:47.823004 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-58a8173c-dbcf-48b9-807b-c8e176177690 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:49:47.823696 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-58a8173c-dbcf-48b9-807b-c8e176177690 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:49:47.824145 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-58a8173c-dbcf-48b9-807b-c8e176177690 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:49:47.824566 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-58a8173c-dbcf-48b9-807b-c8e176177690 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:49:47.962963 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-58a8173c-dbcf-48b9-807b-c8e176177690 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49614df61d1e4c4ebe333db2017e9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac907637c064b2499900b106ea18ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:49:47.971010 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-58a8173c-dbcf-48b9-807b-c8e176177690 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] 10.222.0.20 "GET /compute/v2.1/servers/40063e8e-3745-414b-9fde-cd398bf23c3b" status: 200 len: 1314 microversion: 2.1 time: 0.170393 Aug 09 02:49:47.971582 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 531/1031] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:49:47 2022] GET /compute/v2.1/servers/40063e8e-3745-414b-9fde-cd398bf23c3b => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:49:48.996911 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-ba0ee22d-5ef1-4231-8084-dff3076b715b tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:49:48.998022 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-ba0ee22d-5ef1-4231-8084-dff3076b715b tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] [instance: 40063e8e-3745-414b-9fde-cd398bf23c3b] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:49:49.008491 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ba0ee22d-5ef1-4231-8084-dff3076b715b tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:49:49.009287 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ba0ee22d-5ef1-4231-8084-dff3076b715b tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:49:49.010011 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ba0ee22d-5ef1-4231-8084-dff3076b715b tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:49:49.011217 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ba0ee22d-5ef1-4231-8084-dff3076b715b tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:49:49.011965 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ba0ee22d-5ef1-4231-8084-dff3076b715b tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:49:49.012720 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-ba0ee22d-5ef1-4231-8084-dff3076b715b tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:49:49.147855 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-ba0ee22d-5ef1-4231-8084-dff3076b715b tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49614df61d1e4c4ebe333db2017e9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac907637c064b2499900b106ea18ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:49:49.155868 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-ba0ee22d-5ef1-4231-8084-dff3076b715b tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] 10.222.0.20 "GET /compute/v2.1/servers/40063e8e-3745-414b-9fde-cd398bf23c3b" status: 200 len: 1314 microversion: 2.1 time: 0.167017 Aug 09 02:49:49.156450 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 501/1032] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:49:48 2022] GET /compute/v2.1/servers/40063e8e-3745-414b-9fde-cd398bf23c3b => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:49:50.181241 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-a3f93f19-4d4e-4eea-bb0e-07776b86127d tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:49:50.182124 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-a3f93f19-4d4e-4eea-bb0e-07776b86127d tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] [instance: 40063e8e-3745-414b-9fde-cd398bf23c3b] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:49:50.193042 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a3f93f19-4d4e-4eea-bb0e-07776b86127d tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:49:50.193880 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a3f93f19-4d4e-4eea-bb0e-07776b86127d tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:49:50.194645 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a3f93f19-4d4e-4eea-bb0e-07776b86127d tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:49:50.195763 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a3f93f19-4d4e-4eea-bb0e-07776b86127d tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:49:50.196514 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a3f93f19-4d4e-4eea-bb0e-07776b86127d tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:49:50.197213 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a3f93f19-4d4e-4eea-bb0e-07776b86127d tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:49:50.340107 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-a3f93f19-4d4e-4eea-bb0e-07776b86127d tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49614df61d1e4c4ebe333db2017e9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac907637c064b2499900b106ea18ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:49:50.348206 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-a3f93f19-4d4e-4eea-bb0e-07776b86127d tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] 10.222.0.20 "GET /compute/v2.1/servers/40063e8e-3745-414b-9fde-cd398bf23c3b" status: 200 len: 1314 microversion: 2.1 time: 0.173754 Aug 09 02:49:50.348773 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 532/1033] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:49:50 2022] GET /compute/v2.1/servers/40063e8e-3745-414b-9fde-cd398bf23c3b => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:49:51.371179 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-261a52a3-8162-465e-ba02-f9f8133e9b11 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:49:51.371986 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-261a52a3-8162-465e-ba02-f9f8133e9b11 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] [instance: 40063e8e-3745-414b-9fde-cd398bf23c3b] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:49:51.379890 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-261a52a3-8162-465e-ba02-f9f8133e9b11 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:49:51.380360 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-261a52a3-8162-465e-ba02-f9f8133e9b11 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:49:51.380785 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-261a52a3-8162-465e-ba02-f9f8133e9b11 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:49:51.381509 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-261a52a3-8162-465e-ba02-f9f8133e9b11 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:49:51.381957 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-261a52a3-8162-465e-ba02-f9f8133e9b11 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:49:51.382416 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-261a52a3-8162-465e-ba02-f9f8133e9b11 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:49:51.513807 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [req-63feaa54-9f83-4fa8-88ff-7b606399b89e req-c34ee1a3-f66b-4b60-9bae-47108358495c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40063e8e-3745-414b-9fde-cd398bf23c3b", "name": "network-vif-plugged", "status": "completed", "tag": "c2312952-14ae-432e-a8bf-79ca9f0d4844"}]} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:49:51.514949 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-261a52a3-8162-465e-ba02-f9f8133e9b11 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49614df61d1e4c4ebe333db2017e9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac907637c064b2499900b106ea18ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:49:51.523888 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-261a52a3-8162-465e-ba02-f9f8133e9b11 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] 10.222.0.20 "GET /compute/v2.1/servers/40063e8e-3745-414b-9fde-cd398bf23c3b" status: 200 len: 1314 microversion: 2.1 time: 0.157980 Aug 09 02:49:51.525322 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 502/1034] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:49:51 2022] GET /compute/v2.1/servers/40063e8e-3745-414b-9fde-cd398bf23c3b => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:49:51.525623 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-63feaa54-9f83-4fa8-88ff-7b606399b89e req-c34ee1a3-f66b-4b60-9bae-47108358495c service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:49:51.526338 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-63feaa54-9f83-4fa8-88ff-7b606399b89e req-c34ee1a3-f66b-4b60-9bae-47108358495c service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:49:51.526990 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-63feaa54-9f83-4fa8-88ff-7b606399b89e req-c34ee1a3-f66b-4b60-9bae-47108358495c service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:49:51.539467 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.compute.server_external_events [req-63feaa54-9f83-4fa8-88ff-7b606399b89e req-c34ee1a3-f66b-4b60-9bae-47108358495c service nova] Creating event network-vif-plugged:c2312952-14ae-432e-a8bf-79ca9f0d4844 for instance 40063e8e-3745-414b-9fde-cd398bf23c3b on hv-cinder-85246 Aug 09 02:49:51.544506 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [req-63feaa54-9f83-4fa8-88ff-7b606399b89e req-c34ee1a3-f66b-4b60-9bae-47108358495c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035227 Aug 09 02:49:51.545247 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 533/1035] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:49:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:49:52.548545 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-b6c07fe0-b2ae-4f03-b059-afcfb2403471 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:49:52.549163 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-b6c07fe0-b2ae-4f03-b059-afcfb2403471 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] [instance: 40063e8e-3745-414b-9fde-cd398bf23c3b] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:49:52.556228 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b6c07fe0-b2ae-4f03-b059-afcfb2403471 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:49:52.556720 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b6c07fe0-b2ae-4f03-b059-afcfb2403471 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:49:52.557184 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b6c07fe0-b2ae-4f03-b059-afcfb2403471 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:49:52.557880 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b6c07fe0-b2ae-4f03-b059-afcfb2403471 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:49:52.558374 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b6c07fe0-b2ae-4f03-b059-afcfb2403471 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:49:52.558802 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-b6c07fe0-b2ae-4f03-b059-afcfb2403471 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:49:52.704949 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-b6c07fe0-b2ae-4f03-b059-afcfb2403471 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49614df61d1e4c4ebe333db2017e9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac907637c064b2499900b106ea18ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:49:52.712779 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-b6c07fe0-b2ae-4f03-b059-afcfb2403471 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] 10.222.0.20 "GET /compute/v2.1/servers/40063e8e-3745-414b-9fde-cd398bf23c3b" status: 200 len: 1314 microversion: 2.1 time: 0.170372 Aug 09 02:49:52.713350 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 503/1036] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:49:52 2022] GET /compute/v2.1/servers/40063e8e-3745-414b-9fde-cd398bf23c3b => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:49:53.738974 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-6af3bd2d-3165-4835-8071-5c51516ef7fc tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:49:53.740025 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-6af3bd2d-3165-4835-8071-5c51516ef7fc tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] [instance: 40063e8e-3745-414b-9fde-cd398bf23c3b] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:49:53.751175 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6af3bd2d-3165-4835-8071-5c51516ef7fc tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:49:53.751661 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6af3bd2d-3165-4835-8071-5c51516ef7fc tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:49:53.752090 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6af3bd2d-3165-4835-8071-5c51516ef7fc tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:49:53.752784 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6af3bd2d-3165-4835-8071-5c51516ef7fc tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:49:53.753239 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6af3bd2d-3165-4835-8071-5c51516ef7fc tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:49:53.753661 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6af3bd2d-3165-4835-8071-5c51516ef7fc tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:49:53.887254 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-6af3bd2d-3165-4835-8071-5c51516ef7fc tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49614df61d1e4c4ebe333db2017e9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac907637c064b2499900b106ea18ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:49:53.895493 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-6af3bd2d-3165-4835-8071-5c51516ef7fc tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] 10.222.0.20 "GET /compute/v2.1/servers/40063e8e-3745-414b-9fde-cd398bf23c3b" status: 200 len: 1498 microversion: 2.1 time: 0.164326 Aug 09 02:49:53.896069 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 534/1037] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:49:53 2022] GET /compute/v2.1/servers/40063e8e-3745-414b-9fde-cd398bf23c3b => generated 1498 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:49:54.459517 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-d976962b-dc7c-4092-8de6-bb70e4bec77f tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:49:54.460058 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-d976962b-dc7c-4092-8de6-bb70e4bec77f tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] [instance: 40063e8e-3745-414b-9fde-cd398bf23c3b] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:49:54.462396 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_cell0:SELECT=2 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:49:54.463057 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_cell0:SELECT=6 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:49:54.469840 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d976962b-dc7c-4092-8de6-bb70e4bec77f tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:49:54.470419 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d976962b-dc7c-4092-8de6-bb70e4bec77f tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:49:54.470881 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d976962b-dc7c-4092-8de6-bb70e4bec77f tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:49:54.471981 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d976962b-dc7c-4092-8de6-bb70e4bec77f tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:49:54.472672 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d976962b-dc7c-4092-8de6-bb70e4bec77f tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:49:54.473360 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d976962b-dc7c-4092-8de6-bb70e4bec77f tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:49:54.500902 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-d976962b-dc7c-4092-8de6-bb70e4bec77f tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] [instance: 40063e8e-3745-414b-9fde-cd398bf23c3b] Going to try to terminate instance {{(pid=124425) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 02:49:54.533898 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:49:54.576860 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-d976962b-dc7c-4092-8de6-bb70e4bec77f tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] 10.222.0.20 "DELETE /compute/v2.1/servers/40063e8e-3745-414b-9fde-cd398bf23c3b" status: 204 len: 0 microversion: 2.1 time: 0.121194 Aug 09 02:49:54.577731 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 504/1038] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 9 02:49:54 2022] DELETE /compute/v2.1/servers/40063e8e-3745-414b-9fde-cd398bf23c3b => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 02:49:54.586351 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-384c3c2b-14cd-4e78-92f7-fdefde5dedcd tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:49:54.586986 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-384c3c2b-14cd-4e78-92f7-fdefde5dedcd tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] [instance: 40063e8e-3745-414b-9fde-cd398bf23c3b] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:49:54.588926 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_cell0:SELECT=2 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:49:54.594490 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-384c3c2b-14cd-4e78-92f7-fdefde5dedcd tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:49:54.594974 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-384c3c2b-14cd-4e78-92f7-fdefde5dedcd tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:49:54.595440 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-384c3c2b-14cd-4e78-92f7-fdefde5dedcd tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:49:54.596127 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-384c3c2b-14cd-4e78-92f7-fdefde5dedcd tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:49:54.596578 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-384c3c2b-14cd-4e78-92f7-fdefde5dedcd tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:49:54.597002 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-384c3c2b-14cd-4e78-92f7-fdefde5dedcd tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:49:54.749578 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-384c3c2b-14cd-4e78-92f7-fdefde5dedcd tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49614df61d1e4c4ebe333db2017e9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac907637c064b2499900b106ea18ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:49:54.761972 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-384c3c2b-14cd-4e78-92f7-fdefde5dedcd tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] 10.222.0.20 "GET /compute/v2.1/servers/40063e8e-3745-414b-9fde-cd398bf23c3b" status: 200 len: 1504 microversion: 2.1 time: 0.179231 Aug 09 02:49:54.762879 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 535/1039] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:49:54 2022] GET /compute/v2.1/servers/40063e8e-3745-414b-9fde-cd398bf23c3b => generated 1504 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:49:55.789693 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-aab45e9a-891a-4b0b-aa7f-5556338c1ed6 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:49:55.790959 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-aab45e9a-891a-4b0b-aa7f-5556338c1ed6 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] [instance: 40063e8e-3745-414b-9fde-cd398bf23c3b] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:49:55.800244 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-aab45e9a-891a-4b0b-aa7f-5556338c1ed6 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:49:55.800730 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-aab45e9a-891a-4b0b-aa7f-5556338c1ed6 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:49:55.801159 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-aab45e9a-891a-4b0b-aa7f-5556338c1ed6 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:49:55.801855 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-aab45e9a-891a-4b0b-aa7f-5556338c1ed6 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:49:55.802345 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-aab45e9a-891a-4b0b-aa7f-5556338c1ed6 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:49:55.802797 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-aab45e9a-891a-4b0b-aa7f-5556338c1ed6 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:49:55.939264 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-aab45e9a-891a-4b0b-aa7f-5556338c1ed6 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49614df61d1e4c4ebe333db2017e9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac907637c064b2499900b106ea18ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:49:55.947106 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-aab45e9a-891a-4b0b-aa7f-5556338c1ed6 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] 10.222.0.20 "GET /compute/v2.1/servers/40063e8e-3745-414b-9fde-cd398bf23c3b" status: 200 len: 1504 microversion: 2.1 time: 0.164755 Aug 09 02:49:55.947644 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 505/1040] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:49:55 2022] GET /compute/v2.1/servers/40063e8e-3745-414b-9fde-cd398bf23c3b => generated 1504 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:49:56.548422 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [req-f41f84b5-d010-46eb-adba-cfa29fae7524 req-b94dbd50-9bb7-47e5-8d87-ce04a2a10c8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40063e8e-3745-414b-9fde-cd398bf23c3b", "name": "network-vif-deleted", "tag": "c2312952-14ae-432e-a8bf-79ca9f0d4844"}]} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:49:56.558684 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-f41f84b5-d010-46eb-adba-cfa29fae7524 req-b94dbd50-9bb7-47e5-8d87-ce04a2a10c8b service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:49:56.559154 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-f41f84b5-d010-46eb-adba-cfa29fae7524 req-b94dbd50-9bb7-47e5-8d87-ce04a2a10c8b service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:49:56.559575 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-f41f84b5-d010-46eb-adba-cfa29fae7524 req-b94dbd50-9bb7-47e5-8d87-ce04a2a10c8b service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:49:56.571469 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.compute.server_external_events [req-f41f84b5-d010-46eb-adba-cfa29fae7524 req-b94dbd50-9bb7-47e5-8d87-ce04a2a10c8b service nova] Creating event network-vif-deleted:c2312952-14ae-432e-a8bf-79ca9f0d4844 for instance 40063e8e-3745-414b-9fde-cd398bf23c3b on hv-cinder-85246 Aug 09 02:49:56.576544 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [req-f41f84b5-d010-46eb-adba-cfa29fae7524 req-b94dbd50-9bb7-47e5-8d87-ce04a2a10c8b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031959 Aug 09 02:49:56.577125 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 536/1041] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:49:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:49:56.973411 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-7d77740c-9a61-4a88-a56d-f9a7fcc5ede7 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:49:56.974410 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-7d77740c-9a61-4a88-a56d-f9a7fcc5ede7 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] [instance: 40063e8e-3745-414b-9fde-cd398bf23c3b] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:49:56.987563 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7d77740c-9a61-4a88-a56d-f9a7fcc5ede7 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:49:56.988555 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7d77740c-9a61-4a88-a56d-f9a7fcc5ede7 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:49:56.988555 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7d77740c-9a61-4a88-a56d-f9a7fcc5ede7 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:49:56.989154 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7d77740c-9a61-4a88-a56d-f9a7fcc5ede7 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:49:56.989594 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7d77740c-9a61-4a88-a56d-f9a7fcc5ede7 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:49:56.990044 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7d77740c-9a61-4a88-a56d-f9a7fcc5ede7 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:49:57.030999 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7d77740c-9a61-4a88-a56d-f9a7fcc5ede7 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:49:57.031523 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7d77740c-9a61-4a88-a56d-f9a7fcc5ede7 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:49:57.031951 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-7d77740c-9a61-4a88-a56d-f9a7fcc5ede7 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:49:57.032391 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.objects.instance [None req-7d77740c-9a61-4a88-a56d-f9a7fcc5ede7 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lazy-loading 'fault' on Instance uuid 40063e8e-3745-414b-9fde-cd398bf23c3b {{(pid=124425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 02:49:57.074231 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-7d77740c-9a61-4a88-a56d-f9a7fcc5ede7 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49614df61d1e4c4ebe333db2017e9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac907637c064b2499900b106ea18ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:49:57.084972 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-7d77740c-9a61-4a88-a56d-f9a7fcc5ede7 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] 10.222.0.20 "GET /compute/v2.1/servers/40063e8e-3745-414b-9fde-cd398bf23c3b" status: 200 len: 1304 microversion: 2.1 time: 0.118792 Aug 09 02:49:57.092964 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 506/1042] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:49:56 2022] GET /compute/v2.1/servers/40063e8e-3745-414b-9fde-cd398bf23c3b => generated 1304 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:49:58.113767 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-e4970ca2-0c9b-48ef-8156-d0c53e4fdb13 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:49:58.114967 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-e4970ca2-0c9b-48ef-8156-d0c53e4fdb13 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] [instance: 40063e8e-3745-414b-9fde-cd398bf23c3b] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:49:58.117951 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:49:58.126691 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e4970ca2-0c9b-48ef-8156-d0c53e4fdb13 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:49:58.127173 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e4970ca2-0c9b-48ef-8156-d0c53e4fdb13 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:49:58.127613 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e4970ca2-0c9b-48ef-8156-d0c53e4fdb13 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:49:58.128299 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e4970ca2-0c9b-48ef-8156-d0c53e4fdb13 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:49:58.128752 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e4970ca2-0c9b-48ef-8156-d0c53e4fdb13 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:49:58.129169 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e4970ca2-0c9b-48ef-8156-d0c53e4fdb13 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:49:58.132611 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_cell1:SELECT=75 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:49:58.144407 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.wsgi [None req-e4970ca2-0c9b-48ef-8156-d0c53e4fdb13 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] HTTP exception thrown: Instance 40063e8e-3745-414b-9fde-cd398bf23c3b could not be found. Aug 09 02:49:58.146083 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-e4970ca2-0c9b-48ef-8156-d0c53e4fdb13 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Request method failure captured: Aug 09 02:49:58.146083 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: request: GET /compute/v2.1/servers/40063e8e-3745-414b-9fde-cd398bf23c3b HTTP/1.1 Aug 09 02:49:58.146083 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Accept: application/json Aug 09 02:49:58.146083 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Accept-Encoding: identity Aug 09 02:49:58.146083 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Connection: close Aug 09 02:49:58.146083 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Content-Length: 0 Aug 09 02:49:58.146083 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Content-Type: application/json Aug 09 02:49:58.146083 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Host: 10.222.0.20 Aug 09 02:49:58.146083 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Openstack-System-Scope: None Aug 09 02:49:58.146083 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: User-Agent: python-urllib3/1.26.11 Aug 09 02:49:58.146083 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Auth-Token: gAAAAABi8cs2HsEmfJIfffHPUtK0oCt_iIkRxbLOqIOoB8qOm1KfmVX8EzlPD4-aGteZyt7pWZ5XvEpjKNcqUts28uO2lkUu73RrUSC5XXCmrTVmoYECGSzutTEdpRNZ8dwdhrcr44Qud499kWmsowgxJ_KHP32jIt9999IQ3H5rpgrtSOIPtxE Aug 09 02:49:58.146083 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Domain-Id: None Aug 09 02:49:58.146083 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Domain-Name: None Aug 09 02:49:58.146083 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Identity-Status: Confirmed Aug 09 02:49:58.146083 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Is-Admin-Project: True Aug 09 02:49:58.146083 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Domain-Id: default Aug 09 02:49:58.146083 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Domain-Name: Default Aug 09 02:49:58.146083 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Id: 1ac907637c064b2499900b106ea18ab0 Aug 09 02:49:58.146083 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Name: tempest-VolumesActionsTest-1907156629 Aug 09 02:49:58.146083 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Role: reader,member Aug 09 02:49:58.146083 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Roles: reader,member Aug 09 02:49:58.147731 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1ac907637c064b2499900b106ea18ab0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1ac907637c064b2499900b106ea18ab0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1ac907637c064b2499900b106ea18ab0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1ac907637c064b2499900b106ea18ab0"}]}] Aug 09 02:49:58.147731 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant: tempest-VolumesActionsTest-1907156629 Aug 09 02:49:58.147731 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant-Id: 1ac907637c064b2499900b106ea18ab0 Aug 09 02:49:58.147731 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant-Name: tempest-VolumesActionsTest-1907156629 Aug 09 02:49:58.147731 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User: tempest-VolumesActionsTest-1907156629-project Aug 09 02:49:58.147731 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Domain-Id: default Aug 09 02:49:58.147731 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Domain-Name: Default Aug 09 02:49:58.147731 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Id: 49614df61d1e4c4ebe333db2017e9636 Aug 09 02:49:58.147731 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Name: tempest-VolumesActionsTest-1907156629-project Aug 09 02:49:58.147731 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: method: > Aug 09 02:49:58.147731 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: exception: Instance 40063e8e-3745-414b-9fde-cd398bf23c3b could not be found. Aug 09 02:49:58.147731 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: action_args: {'id': '40063e8e-3745-414b-9fde-cd398bf23c3b'} Aug 09 02:49:58.148577 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 02:49:58.148577 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:49:58.148577 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 02:49:58.148577 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 02:49:58.148577 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 02:49:58.148577 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 02:49:58.148577 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 02:49:58.148577 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 02:49:58.148577 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 02:49:58.148577 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 02:49:58.148577 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40063e8e-3745-414b-9fde-cd398bf23c3b could not be found. Aug 09 02:49:58.148577 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:49:58.148577 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:49:58.148577 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:49:58.148577 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:49:58.148577 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:49:58.148577 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:49:58.148577 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 02:49:58.148577 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 02:49:58.148577 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 02:49:58.149972 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 02:49:58.149972 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 02:49:58.149972 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 02:49:58.149972 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 02:49:58.149972 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 02:49:58.149972 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 02:49:58.149972 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 02:49:58.149972 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40063e8e-3745-414b-9fde-cd398bf23c3b could not be found. Aug 09 02:49:58.149972 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:49:58.149972 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:49:58.149972 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:49:58.149972 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:49:58.149972 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:49:58.149972 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:49:58.149972 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 02:49:58.149972 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 02:49:58.149972 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40063e8e-3745-414b-9fde-cd398bf23c3b could not be found. Aug 09 02:49:58.149972 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:49:58.151457 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-e4970ca2-0c9b-48ef-8156-d0c53e4fdb13 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] Returning 404 to user: Instance 40063e8e-3745-414b-9fde-cd398bf23c3b could not be found. {{(pid=124427) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 02:49:58.151457 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-e4970ca2-0c9b-48ef-8156-d0c53e4fdb13 tempest-VolumesActionsTest-1907156629 tempest-VolumesActionsTest-1907156629-project] 10.222.0.20 "GET /compute/v2.1/servers/40063e8e-3745-414b-9fde-cd398bf23c3b" status: 404 len: 111 microversion: 2.1 time: 0.041930 Aug 09 02:49:58.151457 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 537/1043] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:49:58 2022] GET /compute/v2.1/servers/40063e8e-3745-414b-9fde-cd398bf23c3b => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 02:50:24.031261 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-01dad5ea-8960-4f05-872e-da6659f3dee3 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1187350908", "imageRef": "04a06944-b2a8-4a65-b2a6-7ed3ff18a627", "flavorRef": "452", "networks": [{"uuid": "cfd0a97e-acef-4bf5-b59f-a3b4522b722e"}]}} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:50:24.039806 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:50:24.040412 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_cell1:SELECT=17,nova_cell1:INSERT=1 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:50:24.087558 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.network.neutron [None req-01dad5ea-8960-4f05-872e-da6659f3dee3 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] validate_networks() for [('cfd0a97e-acef-4bf5-b59f-a3b4522b722e', None, None, None, None, None)] {{(pid=124425) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 02:50:24.450638 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.virt.hardware [None req-01dad5ea-8960-4f05-872e-da6659f3dee3 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Flavor limits 0:0:0 {{(pid=124425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 02:50:24.451061 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.virt.hardware [None req-01dad5ea-8960-4f05-872e-da6659f3dee3 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Image limits 0:0:0 {{(pid=124425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 02:50:24.451529 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.virt.hardware [None req-01dad5ea-8960-4f05-872e-da6659f3dee3 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Flavor pref 0:0:0 {{(pid=124425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 02:50:24.451937 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.virt.hardware [None req-01dad5ea-8960-4f05-872e-da6659f3dee3 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Image pref 0:0:0 {{(pid=124425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 02:50:24.452345 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.virt.hardware [None req-01dad5ea-8960-4f05-872e-da6659f3dee3 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 02:50:24.462106 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-01dad5ea-8960-4f05-872e-da6659f3dee3 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:24.462629 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-01dad5ea-8960-4f05-872e-da6659f3dee3 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:24.463068 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-01dad5ea-8960-4f05-872e-da6659f3dee3 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:24.463807 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-01dad5ea-8960-4f05-872e-da6659f3dee3 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:24.464262 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-01dad5ea-8960-4f05-872e-da6659f3dee3 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:24.464709 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-01dad5ea-8960-4f05-872e-da6659f3dee3 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:24.485104 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.quota [None req-01dad5ea-8960-4f05-872e-da6659f3dee3 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Getting quotas for project d488e2c8749640a0b3a9b0037051ff12. Resources: {'cores', 'ram', 'instances'} {{(pid=124425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 02:50:24.489711 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.quota [None req-01dad5ea-8960-4f05-872e-da6659f3dee3 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Getting quotas for user 9e5f6c1a1f07409483d732db05256f1b and project d488e2c8749640a0b3a9b0037051ff12. Resources: {'cores', 'ram', 'instances'} {{(pid=124425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 02:50:24.500905 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-01dad5ea-8960-4f05-872e-da6659f3dee3 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Going to run 1 instances... {{(pid=124425) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 02:50:24.503239 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-01dad5ea-8960-4f05-872e-da6659f3dee3 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] [instance: b6c735ed-12c9-45e8-b664-b1531b362775] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='04a06944-b2a8-4a65-b2a6-7ed3ff18a627',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 02:50:24.547798 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-01dad5ea-8960-4f05-872e-da6659f3dee3 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.520385 Aug 09 02:50:24.548475 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 507/1044] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Aug 9 02:50:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 522 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 02:50:24.559853 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-999a9dc4-2e26-4197-a050-21b81b512c42 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:50:24.560615 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-999a9dc4-2e26-4197-a050-21b81b512c42 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] [instance: b6c735ed-12c9-45e8-b664-b1531b362775] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:50:24.562864 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_api:SELECT=1 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:50:24.563678 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_cell1:SELECT=1 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:50:24.625871 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-999a9dc4-2e26-4197-a050-21b81b512c42 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5f6c1a1f07409483d732db05256f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd488e2c8749640a0b3a9b0037051ff12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:50:24.632678 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-999a9dc4-2e26-4197-a050-21b81b512c42 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] 10.222.0.20 "GET /compute/v2.1/servers/b6c735ed-12c9-45e8-b664-b1531b362775" status: 200 len: 1219 microversion: 2.1 time: 0.077342 Aug 09 02:50:24.633253 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 538/1045] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:50:24 2022] GET /compute/v2.1/servers/b6c735ed-12c9-45e8-b664-b1531b362775 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:50:25.654391 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-bd71301c-eb7b-404d-a8d4-81d91770840c tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:50:25.655715 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-bd71301c-eb7b-404d-a8d4-81d91770840c tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] [instance: b6c735ed-12c9-45e8-b664-b1531b362775] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:50:25.662729 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-bd71301c-eb7b-404d-a8d4-81d91770840c tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:25.663468 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-bd71301c-eb7b-404d-a8d4-81d91770840c tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:25.665859 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-bd71301c-eb7b-404d-a8d4-81d91770840c tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:25.666808 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-bd71301c-eb7b-404d-a8d4-81d91770840c tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:25.667259 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-bd71301c-eb7b-404d-a8d4-81d91770840c tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:25.668018 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-bd71301c-eb7b-404d-a8d4-81d91770840c tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:25.761641 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-bd71301c-eb7b-404d-a8d4-81d91770840c tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5f6c1a1f07409483d732db05256f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd488e2c8749640a0b3a9b0037051ff12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:50:25.769526 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-bd71301c-eb7b-404d-a8d4-81d91770840c tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] 10.222.0.20 "GET /compute/v2.1/servers/b6c735ed-12c9-45e8-b664-b1531b362775" status: 200 len: 1289 microversion: 2.1 time: 0.120513 Aug 09 02:50:25.770284 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 508/1046] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:50:25 2022] GET /compute/v2.1/servers/b6c735ed-12c9-45e8-b664-b1531b362775 => generated 1289 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:50:26.442199 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-17bef24b-0a63-422e-8aef-2b7fcd426c1b tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:50:26.443061 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-17bef24b-0a63-422e-8aef-2b7fcd426c1b tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 088a9dcc-2c63-4ce0-803a-24abd76c0957] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:50:26.450686 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-17bef24b-0a63-422e-8aef-2b7fcd426c1b tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:26.451498 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-17bef24b-0a63-422e-8aef-2b7fcd426c1b tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:26.452015 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-17bef24b-0a63-422e-8aef-2b7fcd426c1b tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:26.452892 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-17bef24b-0a63-422e-8aef-2b7fcd426c1b tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:26.453607 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-17bef24b-0a63-422e-8aef-2b7fcd426c1b tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:26.454236 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-17bef24b-0a63-422e-8aef-2b7fcd426c1b tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:26.465718 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [req-58a310f4-ceeb-47b2-a281-de8b1fe8c284 req-5688e291-64cc-42dd-ad89-0e2686322567 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "088a9dcc-2c63-4ce0-803a-24abd76c0957", "tag": "83f25e4f-a0a2-405d-90b0-5f49d4471e1e"}]} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:50:26.478212 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-58a310f4-ceeb-47b2-a281-de8b1fe8c284 req-5688e291-64cc-42dd-ad89-0e2686322567 service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:26.478907 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-58a310f4-ceeb-47b2-a281-de8b1fe8c284 req-5688e291-64cc-42dd-ad89-0e2686322567 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:26.479456 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-58a310f4-ceeb-47b2-a281-de8b1fe8c284 req-5688e291-64cc-42dd-ad89-0e2686322567 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:26.490347 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-17bef24b-0a63-422e-8aef-2b7fcd426c1b tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 088a9dcc-2c63-4ce0-803a-24abd76c0957] Going to try to terminate instance {{(pid=124427) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 02:50:26.495401 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.compute.server_external_events [req-58a310f4-ceeb-47b2-a281-de8b1fe8c284 req-5688e291-64cc-42dd-ad89-0e2686322567 service nova] Creating event network-changed:83f25e4f-a0a2-405d-90b0-5f49d4471e1e for instance 088a9dcc-2c63-4ce0-803a-24abd76c0957 on hv-cinder-85246 Aug 09 02:50:26.502824 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [req-58a310f4-ceeb-47b2-a281-de8b1fe8c284 req-5688e291-64cc-42dd-ad89-0e2686322567 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040719 Aug 09 02:50:26.504357 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 509/1047] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:50:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:50:26.599661 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-17bef24b-0a63-422e-8aef-2b7fcd426c1b tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "DELETE /compute/v2.1/servers/088a9dcc-2c63-4ce0-803a-24abd76c0957" status: 204 len: 0 microversion: 2.1 time: 0.160267 Aug 09 02:50:26.603849 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 539/1048] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 9 02:50:26 2022] DELETE /compute/v2.1/servers/088a9dcc-2c63-4ce0-803a-24abd76c0957 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 02:50:26.611460 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-6e6b5844-4292-40eb-96ac-be614368a7d9 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:50:26.613059 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-6e6b5844-4292-40eb-96ac-be614368a7d9 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 088a9dcc-2c63-4ce0-803a-24abd76c0957] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:50:26.620271 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6e6b5844-4292-40eb-96ac-be614368a7d9 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:26.621029 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6e6b5844-4292-40eb-96ac-be614368a7d9 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:26.621773 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6e6b5844-4292-40eb-96ac-be614368a7d9 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:26.622700 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6e6b5844-4292-40eb-96ac-be614368a7d9 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:26.623310 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6e6b5844-4292-40eb-96ac-be614368a7d9 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:26.623885 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6e6b5844-4292-40eb-96ac-be614368a7d9 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:26.795797 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-db9118d5-8722-48ad-bc4a-99d04279294d tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:50:26.796487 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-db9118d5-8722-48ad-bc4a-99d04279294d tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] [instance: b6c735ed-12c9-45e8-b664-b1531b362775] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:50:26.802961 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-db9118d5-8722-48ad-bc4a-99d04279294d tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:26.803711 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-db9118d5-8722-48ad-bc4a-99d04279294d tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:26.804329 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-db9118d5-8722-48ad-bc4a-99d04279294d tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:26.805020 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-db9118d5-8722-48ad-bc4a-99d04279294d tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:26.805445 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-db9118d5-8722-48ad-bc4a-99d04279294d tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:26.806056 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-db9118d5-8722-48ad-bc4a-99d04279294d tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:26.872211 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-6e6b5844-4292-40eb-96ac-be614368a7d9 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:50:26.890811 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-6e6b5844-4292-40eb-96ac-be614368a7d9 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/088a9dcc-2c63-4ce0-803a-24abd76c0957" status: 200 len: 1576 microversion: 2.1 time: 0.285324 Aug 09 02:50:26.903440 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 510/1049] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:50:26 2022] GET /compute/v2.1/servers/088a9dcc-2c63-4ce0-803a-24abd76c0957 => generated 1576 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:50:27.122707 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-db9118d5-8722-48ad-bc4a-99d04279294d tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5f6c1a1f07409483d732db05256f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd488e2c8749640a0b3a9b0037051ff12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:50:27.130347 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-db9118d5-8722-48ad-bc4a-99d04279294d tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] 10.222.0.20 "GET /compute/v2.1/servers/b6c735ed-12c9-45e8-b664-b1531b362775" status: 200 len: 1319 microversion: 2.1 time: 0.338767 Aug 09 02:50:27.130923 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 540/1050] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:50:26 2022] GET /compute/v2.1/servers/b6c735ed-12c9-45e8-b664-b1531b362775 => generated 1319 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:50:27.915838 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-2ca0c7fc-66c3-493d-8049-bd0edb5141e8 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:50:27.916488 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-2ca0c7fc-66c3-493d-8049-bd0edb5141e8 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 088a9dcc-2c63-4ce0-803a-24abd76c0957] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:50:27.923191 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2ca0c7fc-66c3-493d-8049-bd0edb5141e8 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:27.923966 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2ca0c7fc-66c3-493d-8049-bd0edb5141e8 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:27.924396 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2ca0c7fc-66c3-493d-8049-bd0edb5141e8 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:27.925098 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2ca0c7fc-66c3-493d-8049-bd0edb5141e8 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:27.925537 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2ca0c7fc-66c3-493d-8049-bd0edb5141e8 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:27.925953 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-2ca0c7fc-66c3-493d-8049-bd0edb5141e8 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:28.151364 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-01560820-7179-4319-ad8a-8452c7e034ec tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:50:28.152177 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-01560820-7179-4319-ad8a-8452c7e034ec tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] [instance: b6c735ed-12c9-45e8-b664-b1531b362775] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:50:28.159148 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-01560820-7179-4319-ad8a-8452c7e034ec tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:28.159698 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-01560820-7179-4319-ad8a-8452c7e034ec tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:28.160131 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-01560820-7179-4319-ad8a-8452c7e034ec tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:28.160896 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-01560820-7179-4319-ad8a-8452c7e034ec tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:28.161347 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-01560820-7179-4319-ad8a-8452c7e034ec tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:28.161768 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-01560820-7179-4319-ad8a-8452c7e034ec tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:28.237727 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-2ca0c7fc-66c3-493d-8049-bd0edb5141e8 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:50:28.245477 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-2ca0c7fc-66c3-493d-8049-bd0edb5141e8 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/088a9dcc-2c63-4ce0-803a-24abd76c0957" status: 200 len: 1576 microversion: 2.1 time: 0.335240 Aug 09 02:50:28.246041 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 511/1051] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:50:27 2022] GET /compute/v2.1/servers/088a9dcc-2c63-4ce0-803a-24abd76c0957 => generated 1576 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:50:28.357282 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-01560820-7179-4319-ad8a-8452c7e034ec tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5f6c1a1f07409483d732db05256f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd488e2c8749640a0b3a9b0037051ff12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:50:28.365432 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-01560820-7179-4319-ad8a-8452c7e034ec tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] 10.222.0.20 "GET /compute/v2.1/servers/b6c735ed-12c9-45e8-b664-b1531b362775" status: 200 len: 1319 microversion: 2.1 time: 0.217967 Aug 09 02:50:28.365995 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 541/1052] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:50:28 2022] GET /compute/v2.1/servers/b6c735ed-12c9-45e8-b664-b1531b362775 => generated 1319 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:50:28.517588 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [req-fbf0ab10-8242-4fc4-bc7b-c635ad6d0169 req-949e626a-ea01-45ff-8d37-f5cb1c69be1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6c735ed-12c9-45e8-b664-b1531b362775", "tag": "d301c67a-1ae0-4f8f-aa01-2dd857e5ed86"}]} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:50:28.527173 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-fbf0ab10-8242-4fc4-bc7b-c635ad6d0169 req-949e626a-ea01-45ff-8d37-f5cb1c69be1c service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:28.527641 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-fbf0ab10-8242-4fc4-bc7b-c635ad6d0169 req-949e626a-ea01-45ff-8d37-f5cb1c69be1c service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:28.528064 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-fbf0ab10-8242-4fc4-bc7b-c635ad6d0169 req-949e626a-ea01-45ff-8d37-f5cb1c69be1c service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:28.539649 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.compute.server_external_events [req-fbf0ab10-8242-4fc4-bc7b-c635ad6d0169 req-949e626a-ea01-45ff-8d37-f5cb1c69be1c service nova] Creating event network-changed:d301c67a-1ae0-4f8f-aa01-2dd857e5ed86 for instance b6c735ed-12c9-45e8-b664-b1531b362775 on hv-cinder-85246 Aug 09 02:50:28.544327 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [req-fbf0ab10-8242-4fc4-bc7b-c635ad6d0169 req-949e626a-ea01-45ff-8d37-f5cb1c69be1c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030516 Aug 09 02:50:28.544948 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 512/1053] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:50:29.270085 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-55d7b84a-a377-460c-91de-22feb0fc7880 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:50:29.271026 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-55d7b84a-a377-460c-91de-22feb0fc7880 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 088a9dcc-2c63-4ce0-803a-24abd76c0957] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:50:29.281920 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-55d7b84a-a377-460c-91de-22feb0fc7880 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:29.282774 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-55d7b84a-a377-460c-91de-22feb0fc7880 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:29.283492 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-55d7b84a-a377-460c-91de-22feb0fc7880 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:29.284621 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-55d7b84a-a377-460c-91de-22feb0fc7880 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:29.285361 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-55d7b84a-a377-460c-91de-22feb0fc7880 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:29.286327 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-55d7b84a-a377-460c-91de-22feb0fc7880 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:29.386981 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-208ef444-f062-4a70-bdee-bf3c06e83f31 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:50:29.387747 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-208ef444-f062-4a70-bdee-bf3c06e83f31 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] [instance: b6c735ed-12c9-45e8-b664-b1531b362775] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:50:29.394514 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-208ef444-f062-4a70-bdee-bf3c06e83f31 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:29.394992 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-208ef444-f062-4a70-bdee-bf3c06e83f31 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:29.395424 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-208ef444-f062-4a70-bdee-bf3c06e83f31 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:29.396140 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-208ef444-f062-4a70-bdee-bf3c06e83f31 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:29.396588 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-208ef444-f062-4a70-bdee-bf3c06e83f31 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:29.397007 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-208ef444-f062-4a70-bdee-bf3c06e83f31 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:29.439533 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-55d7b84a-a377-460c-91de-22feb0fc7880 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:50:29.447525 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-55d7b84a-a377-460c-91de-22feb0fc7880 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/088a9dcc-2c63-4ce0-803a-24abd76c0957" status: 200 len: 1576 microversion: 2.1 time: 0.184014 Aug 09 02:50:29.448081 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 542/1054] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:50:29 2022] GET /compute/v2.1/servers/088a9dcc-2c63-4ce0-803a-24abd76c0957 => generated 1576 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:50:29.538089 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-208ef444-f062-4a70-bdee-bf3c06e83f31 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5f6c1a1f07409483d732db05256f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd488e2c8749640a0b3a9b0037051ff12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:50:29.546276 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-208ef444-f062-4a70-bdee-bf3c06e83f31 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] 10.222.0.20 "GET /compute/v2.1/servers/b6c735ed-12c9-45e8-b664-b1531b362775" status: 200 len: 1319 microversion: 2.1 time: 0.163468 Aug 09 02:50:29.546843 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 513/1055] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:50:29 2022] GET /compute/v2.1/servers/b6c735ed-12c9-45e8-b664-b1531b362775 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:50:30.474107 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-cf9dbafc-2529-46be-a40b-9af8fee49a3d tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:50:30.475392 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-cf9dbafc-2529-46be-a40b-9af8fee49a3d tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 088a9dcc-2c63-4ce0-803a-24abd76c0957] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:50:30.486987 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-cf9dbafc-2529-46be-a40b-9af8fee49a3d tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:30.488040 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-cf9dbafc-2529-46be-a40b-9af8fee49a3d tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:30.488755 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-cf9dbafc-2529-46be-a40b-9af8fee49a3d tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:30.489871 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-cf9dbafc-2529-46be-a40b-9af8fee49a3d tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:30.490645 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-cf9dbafc-2529-46be-a40b-9af8fee49a3d tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:30.491062 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-cf9dbafc-2529-46be-a40b-9af8fee49a3d tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:30.568906 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-35715732-443d-4f35-929d-b63e1f3d477c tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:50:30.569524 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-35715732-443d-4f35-929d-b63e1f3d477c tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] [instance: b6c735ed-12c9-45e8-b664-b1531b362775] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:50:30.576107 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-35715732-443d-4f35-929d-b63e1f3d477c tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:30.576585 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-35715732-443d-4f35-929d-b63e1f3d477c tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:30.577314 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-35715732-443d-4f35-929d-b63e1f3d477c tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:30.577695 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-35715732-443d-4f35-929d-b63e1f3d477c tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:30.578186 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-35715732-443d-4f35-929d-b63e1f3d477c tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:30.578586 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-35715732-443d-4f35-929d-b63e1f3d477c tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:30.669536 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-cf9dbafc-2529-46be-a40b-9af8fee49a3d tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:50:30.677718 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-cf9dbafc-2529-46be-a40b-9af8fee49a3d tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/088a9dcc-2c63-4ce0-803a-24abd76c0957" status: 200 len: 1576 microversion: 2.1 time: 0.210020 Aug 09 02:50:30.678199 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 543/1056] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:50:30 2022] GET /compute/v2.1/servers/088a9dcc-2c63-4ce0-803a-24abd76c0957 => generated 1576 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:50:30.729174 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-35715732-443d-4f35-929d-b63e1f3d477c tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5f6c1a1f07409483d732db05256f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd488e2c8749640a0b3a9b0037051ff12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:50:30.737073 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-35715732-443d-4f35-929d-b63e1f3d477c tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] 10.222.0.20 "GET /compute/v2.1/servers/b6c735ed-12c9-45e8-b664-b1531b362775" status: 200 len: 1319 microversion: 2.1 time: 0.172230 Aug 09 02:50:30.737647 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 514/1057] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:50:30 2022] GET /compute/v2.1/servers/b6c735ed-12c9-45e8-b664-b1531b362775 => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:50:31.703842 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-f9d2bac6-e32f-4929-a640-b255f88feeec tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:50:31.704742 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-f9d2bac6-e32f-4929-a640-b255f88feeec tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 088a9dcc-2c63-4ce0-803a-24abd76c0957] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:50:31.713316 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-f9d2bac6-e32f-4929-a640-b255f88feeec tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:31.713800 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-f9d2bac6-e32f-4929-a640-b255f88feeec tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:31.714273 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-f9d2bac6-e32f-4929-a640-b255f88feeec tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:31.714948 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-f9d2bac6-e32f-4929-a640-b255f88feeec tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:31.715403 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-f9d2bac6-e32f-4929-a640-b255f88feeec tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:31.715831 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-f9d2bac6-e32f-4929-a640-b255f88feeec tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:31.763511 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-71de799f-6427-4638-8a6c-b61673508c84 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:50:31.764087 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-71de799f-6427-4638-8a6c-b61673508c84 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] [instance: b6c735ed-12c9-45e8-b664-b1531b362775] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:50:31.770994 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-71de799f-6427-4638-8a6c-b61673508c84 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:31.771547 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-71de799f-6427-4638-8a6c-b61673508c84 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:31.771980 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-71de799f-6427-4638-8a6c-b61673508c84 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:31.772706 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-71de799f-6427-4638-8a6c-b61673508c84 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:31.773155 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-71de799f-6427-4638-8a6c-b61673508c84 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:31.773572 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-71de799f-6427-4638-8a6c-b61673508c84 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:31.886840 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-f9d2bac6-e32f-4929-a640-b255f88feeec tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:50:31.897132 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-f9d2bac6-e32f-4929-a640-b255f88feeec tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/088a9dcc-2c63-4ce0-803a-24abd76c0957" status: 200 len: 1576 microversion: 2.1 time: 0.199560 Aug 09 02:50:31.902279 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 544/1058] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:50:31 2022] GET /compute/v2.1/servers/088a9dcc-2c63-4ce0-803a-24abd76c0957 => generated 1576 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:50:31.931501 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [req-703903e3-e994-4efc-8630-a15c2d3d2da2 req-cad67f6b-2c16-49b5-bed5-75a6f40a18d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "088a9dcc-2c63-4ce0-803a-24abd76c0957", "name": "network-vif-unplugged", "status": "completed", "tag": "83f25e4f-a0a2-405d-90b0-5f49d4471e1e"}]} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:50:31.934875 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-71de799f-6427-4638-8a6c-b61673508c84 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5f6c1a1f07409483d732db05256f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd488e2c8749640a0b3a9b0037051ff12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:50:31.943638 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-71de799f-6427-4638-8a6c-b61673508c84 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] 10.222.0.20 "GET /compute/v2.1/servers/b6c735ed-12c9-45e8-b664-b1531b362775" status: 200 len: 1319 microversion: 2.1 time: 0.183965 Aug 09 02:50:31.944617 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 515/1059] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:50:31 2022] GET /compute/v2.1/servers/b6c735ed-12c9-45e8-b664-b1531b362775 => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:50:31.949295 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-703903e3-e994-4efc-8630-a15c2d3d2da2 req-cad67f6b-2c16-49b5-bed5-75a6f40a18d1 service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:31.949766 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-703903e3-e994-4efc-8630-a15c2d3d2da2 req-cad67f6b-2c16-49b5-bed5-75a6f40a18d1 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:31.950230 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-703903e3-e994-4efc-8630-a15c2d3d2da2 req-cad67f6b-2c16-49b5-bed5-75a6f40a18d1 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:31.961217 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.compute.server_external_events [req-703903e3-e994-4efc-8630-a15c2d3d2da2 req-cad67f6b-2c16-49b5-bed5-75a6f40a18d1 service nova] Creating event network-vif-unplugged:83f25e4f-a0a2-405d-90b0-5f49d4471e1e for instance 088a9dcc-2c63-4ce0-803a-24abd76c0957 on hv-cinder-85246 Aug 09 02:50:31.966143 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [req-703903e3-e994-4efc-8630-a15c2d3d2da2 req-cad67f6b-2c16-49b5-bed5-75a6f40a18d1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038759 Aug 09 02:50:31.966743 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 545/1060] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:50:32.919827 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-cedab1d5-e9c1-4778-996a-6045cc93dbcc tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:50:32.920433 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-cedab1d5-e9c1-4778-996a-6045cc93dbcc tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 088a9dcc-2c63-4ce0-803a-24abd76c0957] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:50:32.927423 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-cedab1d5-e9c1-4778-996a-6045cc93dbcc tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:32.928054 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-cedab1d5-e9c1-4778-996a-6045cc93dbcc tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:32.928496 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-cedab1d5-e9c1-4778-996a-6045cc93dbcc tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:32.929195 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-cedab1d5-e9c1-4778-996a-6045cc93dbcc tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:32.929657 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-cedab1d5-e9c1-4778-996a-6045cc93dbcc tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:32.930085 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-cedab1d5-e9c1-4778-996a-6045cc93dbcc tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:32.964760 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-3c1d8bbd-8ae0-4efc-964a-7c9be2b77c80 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:50:32.965485 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-3c1d8bbd-8ae0-4efc-964a-7c9be2b77c80 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] [instance: b6c735ed-12c9-45e8-b664-b1531b362775] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:50:32.972421 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3c1d8bbd-8ae0-4efc-964a-7c9be2b77c80 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:32.972899 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3c1d8bbd-8ae0-4efc-964a-7c9be2b77c80 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:32.973326 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3c1d8bbd-8ae0-4efc-964a-7c9be2b77c80 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:32.974014 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3c1d8bbd-8ae0-4efc-964a-7c9be2b77c80 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:32.974485 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3c1d8bbd-8ae0-4efc-964a-7c9be2b77c80 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:32.974900 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3c1d8bbd-8ae0-4efc-964a-7c9be2b77c80 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:33.110565 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-cedab1d5-e9c1-4778-996a-6045cc93dbcc tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:50:33.118537 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-cedab1d5-e9c1-4778-996a-6045cc93dbcc tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/088a9dcc-2c63-4ce0-803a-24abd76c0957" status: 200 len: 1576 microversion: 2.1 time: 0.203108 Aug 09 02:50:33.119126 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 516/1061] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:50:32 2022] GET /compute/v2.1/servers/088a9dcc-2c63-4ce0-803a-24abd76c0957 => generated 1576 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:50:33.140425 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-3c1d8bbd-8ae0-4efc-964a-7c9be2b77c80 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5f6c1a1f07409483d732db05256f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd488e2c8749640a0b3a9b0037051ff12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:50:33.148241 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-3c1d8bbd-8ae0-4efc-964a-7c9be2b77c80 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] 10.222.0.20 "GET /compute/v2.1/servers/b6c735ed-12c9-45e8-b664-b1531b362775" status: 200 len: 1319 microversion: 2.1 time: 0.187592 Aug 09 02:50:33.148798 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 546/1062] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:50:32 2022] GET /compute/v2.1/servers/b6c735ed-12c9-45e8-b664-b1531b362775 => generated 1319 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:50:34.140347 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-8df1d88c-eaa4-4bca-bfa8-8d540a98ea4e tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:50:34.141195 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-8df1d88c-eaa4-4bca-bfa8-8d540a98ea4e tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 088a9dcc-2c63-4ce0-803a-24abd76c0957] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:50:34.148214 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8df1d88c-eaa4-4bca-bfa8-8d540a98ea4e tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:34.148713 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8df1d88c-eaa4-4bca-bfa8-8d540a98ea4e tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:34.149118 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8df1d88c-eaa4-4bca-bfa8-8d540a98ea4e tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:34.149820 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8df1d88c-eaa4-4bca-bfa8-8d540a98ea4e tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:34.150309 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8df1d88c-eaa4-4bca-bfa8-8d540a98ea4e tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:34.150737 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8df1d88c-eaa4-4bca-bfa8-8d540a98ea4e tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:34.170595 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-1fb3d657-662d-4c23-9989-741f9a90bd5f tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:50:34.171172 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-1fb3d657-662d-4c23-9989-741f9a90bd5f tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] [instance: b6c735ed-12c9-45e8-b664-b1531b362775] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:50:34.178723 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1fb3d657-662d-4c23-9989-741f9a90bd5f tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:34.179165 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1fb3d657-662d-4c23-9989-741f9a90bd5f tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:34.180476 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1fb3d657-662d-4c23-9989-741f9a90bd5f tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:34.181488 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1fb3d657-662d-4c23-9989-741f9a90bd5f tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:34.182276 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1fb3d657-662d-4c23-9989-741f9a90bd5f tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:34.183060 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-1fb3d657-662d-4c23-9989-741f9a90bd5f tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:34.243291 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-8df1d88c-eaa4-4bca-bfa8-8d540a98ea4e tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:50:34.251789 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-8df1d88c-eaa4-4bca-bfa8-8d540a98ea4e tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/088a9dcc-2c63-4ce0-803a-24abd76c0957" status: 200 len: 1389 microversion: 2.1 time: 0.115281 Aug 09 02:50:34.265405 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 517/1063] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:50:34 2022] GET /compute/v2.1/servers/088a9dcc-2c63-4ce0-803a-24abd76c0957 => generated 1389 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:50:34.270477 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [req-4bfa1f0e-f4c7-4721-a1cb-fdf957180565 req-f9842fac-f524-42ef-ad86-28603675d4be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "088a9dcc-2c63-4ce0-803a-24abd76c0957", "name": "network-vif-deleted", "tag": "83f25e4f-a0a2-405d-90b0-5f49d4471e1e"}]} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:50:34.280179 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-4bfa1f0e-f4c7-4721-a1cb-fdf957180565 req-f9842fac-f524-42ef-ad86-28603675d4be service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:34.280619 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-4bfa1f0e-f4c7-4721-a1cb-fdf957180565 req-f9842fac-f524-42ef-ad86-28603675d4be service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:34.281260 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-4bfa1f0e-f4c7-4721-a1cb-fdf957180565 req-f9842fac-f524-42ef-ad86-28603675d4be service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:34.293994 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.compute.server_external_events [req-4bfa1f0e-f4c7-4721-a1cb-fdf957180565 req-f9842fac-f524-42ef-ad86-28603675d4be service nova] Creating event network-vif-deleted:83f25e4f-a0a2-405d-90b0-5f49d4471e1e for instance 088a9dcc-2c63-4ce0-803a-24abd76c0957 on hv-cinder-85246 Aug 09 02:50:34.299354 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [req-4bfa1f0e-f4c7-4721-a1cb-fdf957180565 req-f9842fac-f524-42ef-ad86-28603675d4be service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032460 Aug 09 02:50:34.299951 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 518/1064] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:50:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:50:34.417820 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-1fb3d657-662d-4c23-9989-741f9a90bd5f tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5f6c1a1f07409483d732db05256f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd488e2c8749640a0b3a9b0037051ff12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:50:34.427663 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-1fb3d657-662d-4c23-9989-741f9a90bd5f tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] 10.222.0.20 "GET /compute/v2.1/servers/b6c735ed-12c9-45e8-b664-b1531b362775" status: 200 len: 1319 microversion: 2.1 time: 0.261158 Aug 09 02:50:34.428221 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 547/1065] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:50:34 2022] GET /compute/v2.1/servers/b6c735ed-12c9-45e8-b664-b1531b362775 => generated 1319 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:50:35.270407 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_cell0:SELECT=2 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:50:35.271364 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_cell0:SELECT=6 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:50:35.276458 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-621a0eda-65e3-47ff-847b-f11671983f68 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:50:35.277307 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-621a0eda-65e3-47ff-847b-f11671983f68 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 088a9dcc-2c63-4ce0-803a-24abd76c0957] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:50:35.285253 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-621a0eda-65e3-47ff-847b-f11671983f68 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:35.285722 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-621a0eda-65e3-47ff-847b-f11671983f68 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:35.286354 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-621a0eda-65e3-47ff-847b-f11671983f68 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:35.287305 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-621a0eda-65e3-47ff-847b-f11671983f68 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:35.287814 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-621a0eda-65e3-47ff-847b-f11671983f68 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:35.288337 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-621a0eda-65e3-47ff-847b-f11671983f68 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:35.323462 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-621a0eda-65e3-47ff-847b-f11671983f68 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:35.323925 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-621a0eda-65e3-47ff-847b-f11671983f68 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:35.324357 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-621a0eda-65e3-47ff-847b-f11671983f68 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:35.324801 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.objects.instance [None req-621a0eda-65e3-47ff-847b-f11671983f68 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lazy-loading 'fault' on Instance uuid 088a9dcc-2c63-4ce0-803a-24abd76c0957 {{(pid=124425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 02:50:35.366915 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-621a0eda-65e3-47ff-847b-f11671983f68 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:50:35.374626 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-621a0eda-65e3-47ff-847b-f11671983f68 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/088a9dcc-2c63-4ce0-803a-24abd76c0957" status: 200 len: 1228 microversion: 2.1 time: 0.105205 Aug 09 02:50:35.375195 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 519/1066] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:50:35 2022] GET /compute/v2.1/servers/088a9dcc-2c63-4ce0-803a-24abd76c0957 => generated 1228 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:50:35.448388 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-8b192e01-6262-4c0d-9df4-464f2610299a tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:50:35.449031 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-8b192e01-6262-4c0d-9df4-464f2610299a tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] [instance: b6c735ed-12c9-45e8-b664-b1531b362775] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:50:35.451237 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_cell0:SELECT=2 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:50:35.456934 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8b192e01-6262-4c0d-9df4-464f2610299a tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:35.457280 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8b192e01-6262-4c0d-9df4-464f2610299a tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:35.457627 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8b192e01-6262-4c0d-9df4-464f2610299a tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:35.458303 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8b192e01-6262-4c0d-9df4-464f2610299a tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:35.458862 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8b192e01-6262-4c0d-9df4-464f2610299a tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:35.459172 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-8b192e01-6262-4c0d-9df4-464f2610299a tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:35.597432 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-8b192e01-6262-4c0d-9df4-464f2610299a tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5f6c1a1f07409483d732db05256f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd488e2c8749640a0b3a9b0037051ff12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:50:35.606003 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-8b192e01-6262-4c0d-9df4-464f2610299a tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] 10.222.0.20 "GET /compute/v2.1/servers/b6c735ed-12c9-45e8-b664-b1531b362775" status: 200 len: 1319 microversion: 2.1 time: 0.161658 Aug 09 02:50:35.606618 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 548/1067] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:50:35 2022] GET /compute/v2.1/servers/b6c735ed-12c9-45e8-b664-b1531b362775 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:50:36.396313 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-937c9225-72bb-4a58-a157-160c44a92f98 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:50:36.396969 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-937c9225-72bb-4a58-a157-160c44a92f98 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 088a9dcc-2c63-4ce0-803a-24abd76c0957] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:50:36.404012 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-937c9225-72bb-4a58-a157-160c44a92f98 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:36.404536 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-937c9225-72bb-4a58-a157-160c44a92f98 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:36.405150 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-937c9225-72bb-4a58-a157-160c44a92f98 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:36.405879 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-937c9225-72bb-4a58-a157-160c44a92f98 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:36.406366 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-937c9225-72bb-4a58-a157-160c44a92f98 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:36.406785 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-937c9225-72bb-4a58-a157-160c44a92f98 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:36.421791 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.wsgi [None req-937c9225-72bb-4a58-a157-160c44a92f98 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] HTTP exception thrown: Instance 088a9dcc-2c63-4ce0-803a-24abd76c0957 could not be found. Aug 09 02:50:36.423537 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-937c9225-72bb-4a58-a157-160c44a92f98 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Request method failure captured: Aug 09 02:50:36.423537 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: request: GET /compute/v2.1/servers/088a9dcc-2c63-4ce0-803a-24abd76c0957 HTTP/1.1 Aug 09 02:50:36.423537 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Accept: application/json Aug 09 02:50:36.423537 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Accept-Encoding: identity Aug 09 02:50:36.423537 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Connection: close Aug 09 02:50:36.423537 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Content-Length: 0 Aug 09 02:50:36.423537 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Content-Type: application/json Aug 09 02:50:36.423537 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Host: 10.222.0.20 Aug 09 02:50:36.423537 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Openstack-System-Scope: None Aug 09 02:50:36.423537 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: User-Agent: python-urllib3/1.26.11 Aug 09 02:50:36.423537 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Auth-Token: gAAAAABi8cmR_XEASBFZjAVs2tdYwkUdxzYF8jaukiz0_i40mEw8JpEsqOLhjPu0clk-qD9vmP1oTEf4-LR9neo_6zkM9Wy6qiJtcxvv89W5JGUaF5yj24-XvHEG9HkU5wZOUbb8pxncVoJ-L0c8AUP26kM4nuPVsS6zsfalXiIF0K85zBow9x0 Aug 09 02:50:36.423537 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Domain-Id: None Aug 09 02:50:36.423537 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Domain-Name: None Aug 09 02:50:36.423537 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Identity-Status: Confirmed Aug 09 02:50:36.423537 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Is-Admin-Project: True Aug 09 02:50:36.423537 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Domain-Id: default Aug 09 02:50:36.423537 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Domain-Name: Default Aug 09 02:50:36.423537 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Id: 9aadaf242f674436a45eae700fb52fc1 Aug 09 02:50:36.423537 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Name: tempest-TestVolumeBootPattern-1127083574 Aug 09 02:50:36.423537 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Role: reader,member Aug 09 02:50:36.423537 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Roles: reader,member Aug 09 02:50:36.425254 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9aadaf242f674436a45eae700fb52fc1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9aadaf242f674436a45eae700fb52fc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9aadaf242f674436a45eae700fb52fc1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9aadaf242f674436a45eae700fb52fc1"}]}] Aug 09 02:50:36.425254 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant: tempest-TestVolumeBootPattern-1127083574 Aug 09 02:50:36.425254 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant-Id: 9aadaf242f674436a45eae700fb52fc1 Aug 09 02:50:36.425254 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant-Name: tempest-TestVolumeBootPattern-1127083574 Aug 09 02:50:36.425254 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User: tempest-TestVolumeBootPattern-1127083574-project Aug 09 02:50:36.425254 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Domain-Id: default Aug 09 02:50:36.425254 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Domain-Name: Default Aug 09 02:50:36.425254 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Id: 90fa94f90d49485a81d502929bcd0b93 Aug 09 02:50:36.425254 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Name: tempest-TestVolumeBootPattern-1127083574-project Aug 09 02:50:36.425254 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: method: > Aug 09 02:50:36.425254 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: exception: Instance 088a9dcc-2c63-4ce0-803a-24abd76c0957 could not be found. Aug 09 02:50:36.425254 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: action_args: {'id': '088a9dcc-2c63-4ce0-803a-24abd76c0957'} Aug 09 02:50:36.426136 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 02:50:36.426136 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:50:36.426136 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 02:50:36.426136 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 02:50:36.426136 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 02:50:36.426136 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 02:50:36.426136 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 02:50:36.426136 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 02:50:36.426136 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 02:50:36.426136 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 02:50:36.426136 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 088a9dcc-2c63-4ce0-803a-24abd76c0957 could not be found. Aug 09 02:50:36.426136 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:50:36.426136 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:50:36.426136 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:50:36.426136 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:50:36.426136 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:50:36.426136 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:50:36.426136 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 02:50:36.426136 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 02:50:36.426136 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 02:50:36.427964 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 02:50:36.427964 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 02:50:36.427964 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 02:50:36.427964 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 02:50:36.427964 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 02:50:36.427964 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 02:50:36.427964 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 02:50:36.427964 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 088a9dcc-2c63-4ce0-803a-24abd76c0957 could not be found. Aug 09 02:50:36.427964 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:50:36.427964 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:50:36.427964 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:50:36.427964 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:50:36.427964 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:50:36.427964 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:50:36.427964 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 02:50:36.427964 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 02:50:36.427964 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 088a9dcc-2c63-4ce0-803a-24abd76c0957 could not be found. Aug 09 02:50:36.427964 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:50:36.429496 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-937c9225-72bb-4a58-a157-160c44a92f98 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Returning 404 to user: Instance 088a9dcc-2c63-4ce0-803a-24abd76c0957 could not be found. {{(pid=124425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 02:50:36.429496 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-937c9225-72bb-4a58-a157-160c44a92f98 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/088a9dcc-2c63-4ce0-803a-24abd76c0957" status: 404 len: 111 microversion: 2.1 time: 0.033081 Aug 09 02:50:36.429496 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 520/1068] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:50:36 2022] GET /compute/v2.1/servers/088a9dcc-2c63-4ce0-803a-24abd76c0957 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 02:50:36.627573 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-88fa333d-59fa-4c70-a0dc-e32a04f2f5bc tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:50:36.628234 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-88fa333d-59fa-4c70-a0dc-e32a04f2f5bc tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] [instance: b6c735ed-12c9-45e8-b664-b1531b362775] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:50:36.635670 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-88fa333d-59fa-4c70-a0dc-e32a04f2f5bc tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:36.636163 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-88fa333d-59fa-4c70-a0dc-e32a04f2f5bc tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:36.636602 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-88fa333d-59fa-4c70-a0dc-e32a04f2f5bc tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:36.637319 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-88fa333d-59fa-4c70-a0dc-e32a04f2f5bc tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:36.637771 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-88fa333d-59fa-4c70-a0dc-e32a04f2f5bc tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:36.638224 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-88fa333d-59fa-4c70-a0dc-e32a04f2f5bc tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:36.775358 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-88fa333d-59fa-4c70-a0dc-e32a04f2f5bc tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5f6c1a1f07409483d732db05256f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd488e2c8749640a0b3a9b0037051ff12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:50:36.784429 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-88fa333d-59fa-4c70-a0dc-e32a04f2f5bc tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] 10.222.0.20 "GET /compute/v2.1/servers/b6c735ed-12c9-45e8-b664-b1531b362775" status: 200 len: 1319 microversion: 2.1 time: 0.160848 Aug 09 02:50:36.785044 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 549/1069] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:50:36 2022] GET /compute/v2.1/servers/b6c735ed-12c9-45e8-b664-b1531b362775 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:50:37.805919 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-1ff944bc-2c7f-4dd9-af2d-14ac28b52360 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:50:37.806627 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-1ff944bc-2c7f-4dd9-af2d-14ac28b52360 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] [instance: b6c735ed-12c9-45e8-b664-b1531b362775] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:50:37.813243 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1ff944bc-2c7f-4dd9-af2d-14ac28b52360 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:37.813723 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1ff944bc-2c7f-4dd9-af2d-14ac28b52360 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:37.814146 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1ff944bc-2c7f-4dd9-af2d-14ac28b52360 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:37.814868 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1ff944bc-2c7f-4dd9-af2d-14ac28b52360 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:37.815312 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1ff944bc-2c7f-4dd9-af2d-14ac28b52360 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:37.815729 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-1ff944bc-2c7f-4dd9-af2d-14ac28b52360 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:37.944853 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-1ff944bc-2c7f-4dd9-af2d-14ac28b52360 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5f6c1a1f07409483d732db05256f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd488e2c8749640a0b3a9b0037051ff12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:50:37.952518 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-1ff944bc-2c7f-4dd9-af2d-14ac28b52360 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] 10.222.0.20 "GET /compute/v2.1/servers/b6c735ed-12c9-45e8-b664-b1531b362775" status: 200 len: 1319 microversion: 2.1 time: 0.150482 Aug 09 02:50:37.953085 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 521/1070] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:50:37 2022] GET /compute/v2.1/servers/b6c735ed-12c9-45e8-b664-b1531b362775 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:50:38.973159 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-979d73e2-b84c-4514-aa05-56eeee0ad5e8 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:50:38.973825 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-979d73e2-b84c-4514-aa05-56eeee0ad5e8 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] [instance: b6c735ed-12c9-45e8-b664-b1531b362775] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:50:38.980545 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-979d73e2-b84c-4514-aa05-56eeee0ad5e8 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:38.981034 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-979d73e2-b84c-4514-aa05-56eeee0ad5e8 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:38.981504 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-979d73e2-b84c-4514-aa05-56eeee0ad5e8 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:38.982199 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-979d73e2-b84c-4514-aa05-56eeee0ad5e8 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:38.982682 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-979d73e2-b84c-4514-aa05-56eeee0ad5e8 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:38.983104 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-979d73e2-b84c-4514-aa05-56eeee0ad5e8 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:39.186097 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-979d73e2-b84c-4514-aa05-56eeee0ad5e8 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5f6c1a1f07409483d732db05256f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd488e2c8749640a0b3a9b0037051ff12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:50:39.193973 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-979d73e2-b84c-4514-aa05-56eeee0ad5e8 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] 10.222.0.20 "GET /compute/v2.1/servers/b6c735ed-12c9-45e8-b664-b1531b362775" status: 200 len: 1319 microversion: 2.1 time: 0.224820 Aug 09 02:50:39.206959 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 550/1071] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:50:38 2022] GET /compute/v2.1/servers/b6c735ed-12c9-45e8-b664-b1531b362775 => generated 1319 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:50:39.787222 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-6bfbcccb-447d-40d4-ac8a-979f041548cc tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:50:39.787751 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-6bfbcccb-447d-40d4-ac8a-979f041548cc tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 1dc382df-229f-4a7a-9275-51eefdf4ee9a] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:50:39.789073 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [req-19239bfd-b16b-47c9-bac4-047df5d61325 req-7e7e77df-5f3d-4e22-b684-e04a7e9a6c96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1dc382df-229f-4a7a-9275-51eefdf4ee9a", "tag": "4340fc7a-b008-41f2-a681-5a15abc0d9ba"}]} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:50:39.795143 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6bfbcccb-447d-40d4-ac8a-979f041548cc tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:39.795663 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6bfbcccb-447d-40d4-ac8a-979f041548cc tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:39.796097 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6bfbcccb-447d-40d4-ac8a-979f041548cc tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:39.797425 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6bfbcccb-447d-40d4-ac8a-979f041548cc tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:39.798106 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6bfbcccb-447d-40d4-ac8a-979f041548cc tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:39.798556 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-6bfbcccb-447d-40d4-ac8a-979f041548cc tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:39.799112 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-19239bfd-b16b-47c9-bac4-047df5d61325 req-7e7e77df-5f3d-4e22-b684-e04a7e9a6c96 service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:39.799608 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-19239bfd-b16b-47c9-bac4-047df5d61325 req-7e7e77df-5f3d-4e22-b684-e04a7e9a6c96 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:39.800027 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-19239bfd-b16b-47c9-bac4-047df5d61325 req-7e7e77df-5f3d-4e22-b684-e04a7e9a6c96 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:39.811444 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.compute.server_external_events [req-19239bfd-b16b-47c9-bac4-047df5d61325 req-7e7e77df-5f3d-4e22-b684-e04a7e9a6c96 service nova] Creating event network-changed:4340fc7a-b008-41f2-a681-5a15abc0d9ba for instance 1dc382df-229f-4a7a-9275-51eefdf4ee9a on hv-cinder-85246 Aug 09 02:50:39.816752 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [req-19239bfd-b16b-47c9-bac4-047df5d61325 req-7e7e77df-5f3d-4e22-b684-e04a7e9a6c96 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031372 Aug 09 02:50:39.818329 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 551/1072] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:50:39.825574 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-6bfbcccb-447d-40d4-ac8a-979f041548cc tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 1dc382df-229f-4a7a-9275-51eefdf4ee9a] Going to try to terminate instance {{(pid=124425) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 02:50:39.924274 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-6bfbcccb-447d-40d4-ac8a-979f041548cc tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1dc382df-229f-4a7a-9275-51eefdf4ee9a" status: 204 len: 0 microversion: 2.1 time: 0.140908 Aug 09 02:50:39.926929 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 522/1073] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 9 02:50:39 2022] DELETE /compute/v2.1/servers/1dc382df-229f-4a7a-9275-51eefdf4ee9a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 02:50:39.937873 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-08010b06-7dfd-49f6-9b6b-d4b486fc9d1e tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:50:39.939273 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-08010b06-7dfd-49f6-9b6b-d4b486fc9d1e tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 1dc382df-229f-4a7a-9275-51eefdf4ee9a] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:50:39.946208 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-08010b06-7dfd-49f6-9b6b-d4b486fc9d1e tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:39.946707 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-08010b06-7dfd-49f6-9b6b-d4b486fc9d1e tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:39.947136 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-08010b06-7dfd-49f6-9b6b-d4b486fc9d1e tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:39.948018 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-08010b06-7dfd-49f6-9b6b-d4b486fc9d1e tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:39.948651 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-08010b06-7dfd-49f6-9b6b-d4b486fc9d1e tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:39.949248 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-08010b06-7dfd-49f6-9b6b-d4b486fc9d1e tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:40.067445 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [req-ebbdb3f6-ba1e-4f49-96fa-083a98ed87ac req-96c3342d-0962-4f79-abcd-bef1dc0c1861 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6c735ed-12c9-45e8-b664-b1531b362775", "name": "network-vif-plugged", "status": "completed", "tag": "d301c67a-1ae0-4f8f-aa01-2dd857e5ed86"}]} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:50:40.079671 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-ebbdb3f6-ba1e-4f49-96fa-083a98ed87ac req-96c3342d-0962-4f79-abcd-bef1dc0c1861 service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:40.079801 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-ebbdb3f6-ba1e-4f49-96fa-083a98ed87ac req-96c3342d-0962-4f79-abcd-bef1dc0c1861 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:40.080434 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-ebbdb3f6-ba1e-4f49-96fa-083a98ed87ac req-96c3342d-0962-4f79-abcd-bef1dc0c1861 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:40.096664 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-08010b06-7dfd-49f6-9b6b-d4b486fc9d1e tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:50:40.102978 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.compute.server_external_events [req-ebbdb3f6-ba1e-4f49-96fa-083a98ed87ac req-96c3342d-0962-4f79-abcd-bef1dc0c1861 service nova] Creating event network-vif-plugged:d301c67a-1ae0-4f8f-aa01-2dd857e5ed86 for instance b6c735ed-12c9-45e8-b664-b1531b362775 on hv-cinder-85246 Aug 09 02:50:40.105375 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-08010b06-7dfd-49f6-9b6b-d4b486fc9d1e tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/1dc382df-229f-4a7a-9275-51eefdf4ee9a" status: 200 len: 1577 microversion: 2.1 time: 0.173983 Aug 09 02:50:40.108881 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [req-ebbdb3f6-ba1e-4f49-96fa-083a98ed87ac req-96c3342d-0962-4f79-abcd-bef1dc0c1861 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046485 Aug 09 02:50:40.110309 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 523/1074] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:50:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 02:50:40.114949 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 552/1075] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:50:39 2022] GET /compute/v2.1/servers/1dc382df-229f-4a7a-9275-51eefdf4ee9a => generated 1577 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 02:50:40.215521 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-8c57a63e-62ac-45f5-8c54-155cc8c5065b tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:50:40.216222 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-8c57a63e-62ac-45f5-8c54-155cc8c5065b tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] [instance: b6c735ed-12c9-45e8-b664-b1531b362775] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:50:40.222992 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8c57a63e-62ac-45f5-8c54-155cc8c5065b tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:40.223478 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8c57a63e-62ac-45f5-8c54-155cc8c5065b tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:40.223910 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8c57a63e-62ac-45f5-8c54-155cc8c5065b tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:40.224607 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8c57a63e-62ac-45f5-8c54-155cc8c5065b tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:40.225064 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8c57a63e-62ac-45f5-8c54-155cc8c5065b tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:40.225540 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8c57a63e-62ac-45f5-8c54-155cc8c5065b tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:40.623168 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-8c57a63e-62ac-45f5-8c54-155cc8c5065b tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5f6c1a1f07409483d732db05256f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd488e2c8749640a0b3a9b0037051ff12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:50:40.631198 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-8c57a63e-62ac-45f5-8c54-155cc8c5065b tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] 10.222.0.20 "GET /compute/v2.1/servers/b6c735ed-12c9-45e8-b664-b1531b362775" status: 200 len: 1319 microversion: 2.1 time: 0.419898 Aug 09 02:50:40.631888 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 524/1076] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:50:40 2022] GET /compute/v2.1/servers/b6c735ed-12c9-45e8-b664-b1531b362775 => generated 1319 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:50:41.127648 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-db75f0a6-8e96-447d-a15b-07bb0e15460d tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:50:41.128274 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-db75f0a6-8e96-447d-a15b-07bb0e15460d tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 1dc382df-229f-4a7a-9275-51eefdf4ee9a] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:50:41.135625 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-db75f0a6-8e96-447d-a15b-07bb0e15460d tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:41.136087 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-db75f0a6-8e96-447d-a15b-07bb0e15460d tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:41.136535 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-db75f0a6-8e96-447d-a15b-07bb0e15460d tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:41.138486 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-db75f0a6-8e96-447d-a15b-07bb0e15460d tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:41.139163 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-db75f0a6-8e96-447d-a15b-07bb0e15460d tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:41.139544 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-db75f0a6-8e96-447d-a15b-07bb0e15460d tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:41.274480 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-db75f0a6-8e96-447d-a15b-07bb0e15460d tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:50:41.282535 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-db75f0a6-8e96-447d-a15b-07bb0e15460d tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/1dc382df-229f-4a7a-9275-51eefdf4ee9a" status: 200 len: 1577 microversion: 2.1 time: 0.158787 Aug 09 02:50:41.283105 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 553/1077] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:50:41 2022] GET /compute/v2.1/servers/1dc382df-229f-4a7a-9275-51eefdf4ee9a => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:50:41.656112 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-09675630-2907-4283-baff-04f4717b20e4 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:50:41.657026 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-09675630-2907-4283-baff-04f4717b20e4 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] [instance: b6c735ed-12c9-45e8-b664-b1531b362775] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:50:41.665716 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-09675630-2907-4283-baff-04f4717b20e4 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:41.666235 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-09675630-2907-4283-baff-04f4717b20e4 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:41.666678 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-09675630-2907-4283-baff-04f4717b20e4 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:41.667372 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-09675630-2907-4283-baff-04f4717b20e4 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:41.667825 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-09675630-2907-4283-baff-04f4717b20e4 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:41.668247 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-09675630-2907-4283-baff-04f4717b20e4 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:41.686543 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:50:41.799479 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-09675630-2907-4283-baff-04f4717b20e4 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5f6c1a1f07409483d732db05256f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd488e2c8749640a0b3a9b0037051ff12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:50:41.810938 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-09675630-2907-4283-baff-04f4717b20e4 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] 10.222.0.20 "GET /compute/v2.1/servers/b6c735ed-12c9-45e8-b664-b1531b362775" status: 200 len: 1319 microversion: 2.1 time: 0.161022 Aug 09 02:50:41.811637 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 525/1078] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:50:41 2022] GET /compute/v2.1/servers/b6c735ed-12c9-45e8-b664-b1531b362775 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:50:42.305290 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-e8df448d-a184-44e6-a22c-250cb23554c4 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:50:42.305914 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-e8df448d-a184-44e6-a22c-250cb23554c4 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 1dc382df-229f-4a7a-9275-51eefdf4ee9a] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:50:42.313012 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e8df448d-a184-44e6-a22c-250cb23554c4 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:42.313497 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e8df448d-a184-44e6-a22c-250cb23554c4 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:42.313923 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e8df448d-a184-44e6-a22c-250cb23554c4 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:42.314658 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e8df448d-a184-44e6-a22c-250cb23554c4 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:42.315106 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e8df448d-a184-44e6-a22c-250cb23554c4 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:42.315525 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e8df448d-a184-44e6-a22c-250cb23554c4 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:42.531785 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-e8df448d-a184-44e6-a22c-250cb23554c4 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:50:42.542590 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-e8df448d-a184-44e6-a22c-250cb23554c4 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/1dc382df-229f-4a7a-9275-51eefdf4ee9a" status: 200 len: 1577 microversion: 2.1 time: 0.241563 Aug 09 02:50:42.543612 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 554/1079] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:50:42 2022] GET /compute/v2.1/servers/1dc382df-229f-4a7a-9275-51eefdf4ee9a => generated 1577 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:50:42.749026 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [req-d5a976b1-41fe-4d74-a963-8aba290cb4ba req-b3767ffb-8e62-430c-8546-ef73d1636e22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dc382df-229f-4a7a-9275-51eefdf4ee9a", "name": "network-vif-deleted", "tag": "4340fc7a-b008-41f2-a681-5a15abc0d9ba"}]} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:50:42.762384 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-d5a976b1-41fe-4d74-a963-8aba290cb4ba req-b3767ffb-8e62-430c-8546-ef73d1636e22 service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:42.763042 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-d5a976b1-41fe-4d74-a963-8aba290cb4ba req-b3767ffb-8e62-430c-8546-ef73d1636e22 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:42.763505 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-d5a976b1-41fe-4d74-a963-8aba290cb4ba req-b3767ffb-8e62-430c-8546-ef73d1636e22 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:42.777274 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.compute.server_external_events [req-d5a976b1-41fe-4d74-a963-8aba290cb4ba req-b3767ffb-8e62-430c-8546-ef73d1636e22 service nova] Creating event network-vif-deleted:4340fc7a-b008-41f2-a681-5a15abc0d9ba for instance 1dc382df-229f-4a7a-9275-51eefdf4ee9a on hv-cinder-85246 Aug 09 02:50:42.782655 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [req-d5a976b1-41fe-4d74-a963-8aba290cb4ba req-b3767ffb-8e62-430c-8546-ef73d1636e22 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039861 Aug 09 02:50:42.783222 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 526/1080] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:50:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:50:42.831016 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-6246bd54-877f-4ed3-8b97-94f604d30ee7 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:50:42.831610 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-6246bd54-877f-4ed3-8b97-94f604d30ee7 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] [instance: b6c735ed-12c9-45e8-b664-b1531b362775] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:50:42.838042 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6246bd54-877f-4ed3-8b97-94f604d30ee7 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:42.838572 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6246bd54-877f-4ed3-8b97-94f604d30ee7 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:42.839001 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6246bd54-877f-4ed3-8b97-94f604d30ee7 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:42.839677 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6246bd54-877f-4ed3-8b97-94f604d30ee7 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:42.840130 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6246bd54-877f-4ed3-8b97-94f604d30ee7 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:42.840544 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6246bd54-877f-4ed3-8b97-94f604d30ee7 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:42.844795 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:50:43.053186 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-6246bd54-877f-4ed3-8b97-94f604d30ee7 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5f6c1a1f07409483d732db05256f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd488e2c8749640a0b3a9b0037051ff12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:50:43.070661 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-6246bd54-877f-4ed3-8b97-94f604d30ee7 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] 10.222.0.20 "GET /compute/v2.1/servers/b6c735ed-12c9-45e8-b664-b1531b362775" status: 200 len: 1508 microversion: 2.1 time: 0.243275 Aug 09 02:50:43.071907 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 555/1081] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:50:42 2022] GET /compute/v2.1/servers/b6c735ed-12c9-45e8-b664-b1531b362775 => generated 1508 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:50:43.565347 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-0e27a94c-7c68-4841-b072-cdc036f56564 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:50:43.566051 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-0e27a94c-7c68-4841-b072-cdc036f56564 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 1dc382df-229f-4a7a-9275-51eefdf4ee9a] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:50:43.572272 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0e27a94c-7c68-4841-b072-cdc036f56564 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:43.572755 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0e27a94c-7c68-4841-b072-cdc036f56564 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:43.573191 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0e27a94c-7c68-4841-b072-cdc036f56564 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:43.573887 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0e27a94c-7c68-4841-b072-cdc036f56564 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:43.574374 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0e27a94c-7c68-4841-b072-cdc036f56564 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:43.574799 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0e27a94c-7c68-4841-b072-cdc036f56564 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:43.605442 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0e27a94c-7c68-4841-b072-cdc036f56564 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:43.605551 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0e27a94c-7c68-4841-b072-cdc036f56564 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:43.605935 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-0e27a94c-7c68-4841-b072-cdc036f56564 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:43.606450 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.objects.instance [None req-0e27a94c-7c68-4841-b072-cdc036f56564 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lazy-loading 'fault' on Instance uuid 1dc382df-229f-4a7a-9275-51eefdf4ee9a {{(pid=124425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 02:50:43.653010 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-0e27a94c-7c68-4841-b072-cdc036f56564 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fa94f90d49485a81d502929bcd0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadaf242f674436a45eae700fb52fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:50:43.661655 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-0e27a94c-7c68-4841-b072-cdc036f56564 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/1dc382df-229f-4a7a-9275-51eefdf4ee9a" status: 200 len: 1395 microversion: 2.1 time: 0.100973 Aug 09 02:50:43.662779 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 527/1082] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:50:43 2022] GET /compute/v2.1/servers/1dc382df-229f-4a7a-9275-51eefdf4ee9a => generated 1395 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:50:44.683832 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-39a582af-dd8d-45dd-92bd-6ee5a87ece59 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:50:44.684552 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-39a582af-dd8d-45dd-92bd-6ee5a87ece59 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 1dc382df-229f-4a7a-9275-51eefdf4ee9a] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:50:44.691224 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-39a582af-dd8d-45dd-92bd-6ee5a87ece59 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:44.692103 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-39a582af-dd8d-45dd-92bd-6ee5a87ece59 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:44.692624 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-39a582af-dd8d-45dd-92bd-6ee5a87ece59 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:44.693347 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-39a582af-dd8d-45dd-92bd-6ee5a87ece59 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:44.693801 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-39a582af-dd8d-45dd-92bd-6ee5a87ece59 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:44.694243 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-39a582af-dd8d-45dd-92bd-6ee5a87ece59 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:44.708680 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.wsgi [None req-39a582af-dd8d-45dd-92bd-6ee5a87ece59 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] HTTP exception thrown: Instance 1dc382df-229f-4a7a-9275-51eefdf4ee9a could not be found. Aug 09 02:50:44.710381 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-39a582af-dd8d-45dd-92bd-6ee5a87ece59 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Request method failure captured: Aug 09 02:50:44.710381 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: request: GET /compute/v2.1/servers/1dc382df-229f-4a7a-9275-51eefdf4ee9a HTTP/1.1 Aug 09 02:50:44.710381 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Accept: application/json Aug 09 02:50:44.710381 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Accept-Encoding: identity Aug 09 02:50:44.710381 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Connection: close Aug 09 02:50:44.710381 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Content-Length: 0 Aug 09 02:50:44.710381 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Content-Type: application/json Aug 09 02:50:44.710381 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Host: 10.222.0.20 Aug 09 02:50:44.710381 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Openstack-System-Scope: None Aug 09 02:50:44.710381 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: User-Agent: python-urllib3/1.26.11 Aug 09 02:50:44.710381 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Auth-Token: gAAAAABi8cmR_XEASBFZjAVs2tdYwkUdxzYF8jaukiz0_i40mEw8JpEsqOLhjPu0clk-qD9vmP1oTEf4-LR9neo_6zkM9Wy6qiJtcxvv89W5JGUaF5yj24-XvHEG9HkU5wZOUbb8pxncVoJ-L0c8AUP26kM4nuPVsS6zsfalXiIF0K85zBow9x0 Aug 09 02:50:44.710381 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Domain-Id: None Aug 09 02:50:44.710381 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Domain-Name: None Aug 09 02:50:44.710381 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Identity-Status: Confirmed Aug 09 02:50:44.710381 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Is-Admin-Project: True Aug 09 02:50:44.710381 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Domain-Id: default Aug 09 02:50:44.710381 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Domain-Name: Default Aug 09 02:50:44.710381 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Id: 9aadaf242f674436a45eae700fb52fc1 Aug 09 02:50:44.710381 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Name: tempest-TestVolumeBootPattern-1127083574 Aug 09 02:50:44.710381 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Role: reader,member Aug 09 02:50:44.710381 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Roles: reader,member Aug 09 02:50:44.712158 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9aadaf242f674436a45eae700fb52fc1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9aadaf242f674436a45eae700fb52fc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9aadaf242f674436a45eae700fb52fc1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9aadaf242f674436a45eae700fb52fc1"}]}] Aug 09 02:50:44.712158 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant: tempest-TestVolumeBootPattern-1127083574 Aug 09 02:50:44.712158 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant-Id: 9aadaf242f674436a45eae700fb52fc1 Aug 09 02:50:44.712158 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant-Name: tempest-TestVolumeBootPattern-1127083574 Aug 09 02:50:44.712158 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User: tempest-TestVolumeBootPattern-1127083574-project Aug 09 02:50:44.712158 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Domain-Id: default Aug 09 02:50:44.712158 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Domain-Name: Default Aug 09 02:50:44.712158 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Id: 90fa94f90d49485a81d502929bcd0b93 Aug 09 02:50:44.712158 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Name: tempest-TestVolumeBootPattern-1127083574-project Aug 09 02:50:44.712158 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: method: > Aug 09 02:50:44.712158 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: exception: Instance 1dc382df-229f-4a7a-9275-51eefdf4ee9a could not be found. Aug 09 02:50:44.712158 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: action_args: {'id': '1dc382df-229f-4a7a-9275-51eefdf4ee9a'} Aug 09 02:50:44.713221 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 02:50:44.713221 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:50:44.713221 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 02:50:44.713221 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 02:50:44.713221 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 02:50:44.713221 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 02:50:44.713221 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 02:50:44.713221 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 02:50:44.713221 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 02:50:44.713221 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 02:50:44.713221 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1dc382df-229f-4a7a-9275-51eefdf4ee9a could not be found. Aug 09 02:50:44.713221 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:50:44.713221 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:50:44.713221 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:50:44.713221 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:50:44.713221 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:50:44.713221 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:50:44.713221 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 02:50:44.713221 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 02:50:44.713221 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 02:50:44.714860 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 02:50:44.714860 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 02:50:44.714860 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 02:50:44.714860 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 02:50:44.714860 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 02:50:44.714860 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 02:50:44.714860 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 02:50:44.714860 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1dc382df-229f-4a7a-9275-51eefdf4ee9a could not be found. Aug 09 02:50:44.714860 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:50:44.714860 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:50:44.714860 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:50:44.714860 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:50:44.714860 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:50:44.714860 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:50:44.714860 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 02:50:44.714860 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 02:50:44.714860 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1dc382df-229f-4a7a-9275-51eefdf4ee9a could not be found. Aug 09 02:50:44.714860 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:50:44.716190 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-39a582af-dd8d-45dd-92bd-6ee5a87ece59 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Returning 404 to user: Instance 1dc382df-229f-4a7a-9275-51eefdf4ee9a could not be found. {{(pid=124427) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 02:50:44.716190 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-39a582af-dd8d-45dd-92bd-6ee5a87ece59 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/1dc382df-229f-4a7a-9275-51eefdf4ee9a" status: 404 len: 111 microversion: 2.1 time: 0.032026 Aug 09 02:50:44.716190 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 556/1083] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:50:44 2022] GET /compute/v2.1/servers/1dc382df-229f-4a7a-9275-51eefdf4ee9a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 02:50:45.279377 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-aee3f735-2730-40ac-9e62-ed736de25074 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:50:45.279919 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-aee3f735-2730-40ac-9e62-ed736de25074 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 61f94aa1-75dc-4f43-aa71-284c50dc394c] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:50:45.286906 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-aee3f735-2730-40ac-9e62-ed736de25074 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:45.287383 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-aee3f735-2730-40ac-9e62-ed736de25074 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:45.288041 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-aee3f735-2730-40ac-9e62-ed736de25074 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:45.288742 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-aee3f735-2730-40ac-9e62-ed736de25074 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:45.289213 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-aee3f735-2730-40ac-9e62-ed736de25074 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:45.289636 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-aee3f735-2730-40ac-9e62-ed736de25074 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:45.303705 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.wsgi [None req-aee3f735-2730-40ac-9e62-ed736de25074 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] HTTP exception thrown: Instance 61f94aa1-75dc-4f43-aa71-284c50dc394c could not be found. Aug 09 02:50:45.305403 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-aee3f735-2730-40ac-9e62-ed736de25074 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Request method failure captured: Aug 09 02:50:45.305403 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: request: DELETE /compute/v2.1/servers/61f94aa1-75dc-4f43-aa71-284c50dc394c HTTP/1.1 Aug 09 02:50:45.305403 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Accept: application/json Aug 09 02:50:45.305403 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Accept-Encoding: identity Aug 09 02:50:45.305403 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Connection: close Aug 09 02:50:45.305403 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Content-Length: 0 Aug 09 02:50:45.305403 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Content-Type: application/json Aug 09 02:50:45.305403 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Host: 10.222.0.20 Aug 09 02:50:45.305403 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Openstack-System-Scope: None Aug 09 02:50:45.305403 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: User-Agent: python-urllib3/1.26.11 Aug 09 02:50:45.305403 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Auth-Token: gAAAAABi8cmR_XEASBFZjAVs2tdYwkUdxzYF8jaukiz0_i40mEw8JpEsqOLhjPu0clk-qD9vmP1oTEf4-LR9neo_6zkM9Wy6qiJtcxvv89W5JGUaF5yj24-XvHEG9HkU5wZOUbb8pxncVoJ-L0c8AUP26kM4nuPVsS6zsfalXiIF0K85zBow9x0 Aug 09 02:50:45.305403 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Domain-Id: None Aug 09 02:50:45.305403 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Domain-Name: None Aug 09 02:50:45.305403 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Identity-Status: Confirmed Aug 09 02:50:45.305403 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Is-Admin-Project: True Aug 09 02:50:45.305403 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Domain-Id: default Aug 09 02:50:45.305403 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Domain-Name: Default Aug 09 02:50:45.305403 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Id: 9aadaf242f674436a45eae700fb52fc1 Aug 09 02:50:45.305403 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Name: tempest-TestVolumeBootPattern-1127083574 Aug 09 02:50:45.305403 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Role: reader,member Aug 09 02:50:45.305403 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Roles: reader,member Aug 09 02:50:45.307276 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9aadaf242f674436a45eae700fb52fc1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9aadaf242f674436a45eae700fb52fc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9aadaf242f674436a45eae700fb52fc1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9aadaf242f674436a45eae700fb52fc1"}]}] Aug 09 02:50:45.307276 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant: tempest-TestVolumeBootPattern-1127083574 Aug 09 02:50:45.307276 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant-Id: 9aadaf242f674436a45eae700fb52fc1 Aug 09 02:50:45.307276 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant-Name: tempest-TestVolumeBootPattern-1127083574 Aug 09 02:50:45.307276 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User: tempest-TestVolumeBootPattern-1127083574-project Aug 09 02:50:45.307276 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Domain-Id: default Aug 09 02:50:45.307276 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Domain-Name: Default Aug 09 02:50:45.307276 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Id: 90fa94f90d49485a81d502929bcd0b93 Aug 09 02:50:45.307276 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Name: tempest-TestVolumeBootPattern-1127083574-project Aug 09 02:50:45.307276 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: method: > Aug 09 02:50:45.307276 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: exception: Instance 61f94aa1-75dc-4f43-aa71-284c50dc394c could not be found. Aug 09 02:50:45.307276 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: action_args: {'id': '61f94aa1-75dc-4f43-aa71-284c50dc394c'} Aug 09 02:50:45.308276 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 02:50:45.308276 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:50:45.308276 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 02:50:45.308276 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 02:50:45.308276 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 02:50:45.308276 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 02:50:45.308276 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 02:50:45.308276 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 02:50:45.308276 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 02:50:45.308276 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 02:50:45.308276 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61f94aa1-75dc-4f43-aa71-284c50dc394c could not be found. Aug 09 02:50:45.308276 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:50:45.308276 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:50:45.308276 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:50:45.308276 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:50:45.308276 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:50:45.308276 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:50:45.308276 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 02:50:45.308276 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 02:50:45.308276 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 02:50:45.309893 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 02:50:45.309893 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 02:50:45.309893 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 02:50:45.309893 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 02:50:45.309893 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 02:50:45.309893 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 02:50:45.309893 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 02:50:45.309893 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 02:50:45.309893 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 02:50:45.309893 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61f94aa1-75dc-4f43-aa71-284c50dc394c could not be found. Aug 09 02:50:45.309893 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:50:45.309893 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:50:45.309893 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:50:45.309893 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:50:45.309893 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:50:45.309893 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:50:45.309893 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 02:50:45.309893 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 02:50:45.309893 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61f94aa1-75dc-4f43-aa71-284c50dc394c could not be found. Aug 09 02:50:45.309893 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:50:45.311776 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-aee3f735-2730-40ac-9e62-ed736de25074 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Returning 404 to user: Instance 61f94aa1-75dc-4f43-aa71-284c50dc394c could not be found. {{(pid=124425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 02:50:45.311776 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-aee3f735-2730-40ac-9e62-ed736de25074 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "DELETE /compute/v2.1/servers/61f94aa1-75dc-4f43-aa71-284c50dc394c" status: 404 len: 111 microversion: 2.1 time: 0.031429 Aug 09 02:50:45.311776 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 528/1084] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 9 02:50:45 2022] DELETE /compute/v2.1/servers/61f94aa1-75dc-4f43-aa71-284c50dc394c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 02:50:45.315728 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-0dc09fbd-ed9e-436f-b477-87c318e45c45 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:50:45.316352 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-0dc09fbd-ed9e-436f-b477-87c318e45c45 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] [instance: 61f94aa1-75dc-4f43-aa71-284c50dc394c] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:50:45.323637 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0dc09fbd-ed9e-436f-b477-87c318e45c45 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:45.324135 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0dc09fbd-ed9e-436f-b477-87c318e45c45 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:45.324563 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0dc09fbd-ed9e-436f-b477-87c318e45c45 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:45.325289 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0dc09fbd-ed9e-436f-b477-87c318e45c45 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:45.325742 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0dc09fbd-ed9e-436f-b477-87c318e45c45 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:45.326224 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-0dc09fbd-ed9e-436f-b477-87c318e45c45 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:45.340370 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.wsgi [None req-0dc09fbd-ed9e-436f-b477-87c318e45c45 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] HTTP exception thrown: Instance 61f94aa1-75dc-4f43-aa71-284c50dc394c could not be found. Aug 09 02:50:45.341905 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-0dc09fbd-ed9e-436f-b477-87c318e45c45 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Request method failure captured: Aug 09 02:50:45.341905 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: request: GET /compute/v2.1/servers/61f94aa1-75dc-4f43-aa71-284c50dc394c HTTP/1.1 Aug 09 02:50:45.341905 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Accept: application/json Aug 09 02:50:45.341905 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Accept-Encoding: identity Aug 09 02:50:45.341905 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Connection: close Aug 09 02:50:45.341905 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Content-Length: 0 Aug 09 02:50:45.341905 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Content-Type: application/json Aug 09 02:50:45.341905 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Host: 10.222.0.20 Aug 09 02:50:45.341905 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Openstack-System-Scope: None Aug 09 02:50:45.341905 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: User-Agent: python-urllib3/1.26.11 Aug 09 02:50:45.341905 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Auth-Token: gAAAAABi8cmR_XEASBFZjAVs2tdYwkUdxzYF8jaukiz0_i40mEw8JpEsqOLhjPu0clk-qD9vmP1oTEf4-LR9neo_6zkM9Wy6qiJtcxvv89W5JGUaF5yj24-XvHEG9HkU5wZOUbb8pxncVoJ-L0c8AUP26kM4nuPVsS6zsfalXiIF0K85zBow9x0 Aug 09 02:50:45.341905 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Domain-Id: None Aug 09 02:50:45.341905 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Domain-Name: None Aug 09 02:50:45.341905 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Identity-Status: Confirmed Aug 09 02:50:45.341905 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Is-Admin-Project: True Aug 09 02:50:45.341905 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Domain-Id: default Aug 09 02:50:45.341905 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Domain-Name: Default Aug 09 02:50:45.341905 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Id: 9aadaf242f674436a45eae700fb52fc1 Aug 09 02:50:45.341905 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Name: tempest-TestVolumeBootPattern-1127083574 Aug 09 02:50:45.341905 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Role: reader,member Aug 09 02:50:45.341905 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Roles: reader,member Aug 09 02:50:45.344159 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9aadaf242f674436a45eae700fb52fc1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9aadaf242f674436a45eae700fb52fc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9aadaf242f674436a45eae700fb52fc1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9aadaf242f674436a45eae700fb52fc1"}]}] Aug 09 02:50:45.344159 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant: tempest-TestVolumeBootPattern-1127083574 Aug 09 02:50:45.344159 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant-Id: 9aadaf242f674436a45eae700fb52fc1 Aug 09 02:50:45.344159 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant-Name: tempest-TestVolumeBootPattern-1127083574 Aug 09 02:50:45.344159 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User: tempest-TestVolumeBootPattern-1127083574-project Aug 09 02:50:45.344159 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Domain-Id: default Aug 09 02:50:45.344159 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Domain-Name: Default Aug 09 02:50:45.344159 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Id: 90fa94f90d49485a81d502929bcd0b93 Aug 09 02:50:45.344159 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Name: tempest-TestVolumeBootPattern-1127083574-project Aug 09 02:50:45.344159 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: method: > Aug 09 02:50:45.344159 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: exception: Instance 61f94aa1-75dc-4f43-aa71-284c50dc394c could not be found. Aug 09 02:50:45.344159 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: action_args: {'id': '61f94aa1-75dc-4f43-aa71-284c50dc394c'} Aug 09 02:50:45.345340 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 02:50:45.345340 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:50:45.345340 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 02:50:45.345340 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 02:50:45.345340 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 02:50:45.345340 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 02:50:45.345340 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 02:50:45.345340 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 02:50:45.345340 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 02:50:45.345340 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 02:50:45.345340 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61f94aa1-75dc-4f43-aa71-284c50dc394c could not be found. Aug 09 02:50:45.345340 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:50:45.345340 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:50:45.345340 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:50:45.345340 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:50:45.345340 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:50:45.345340 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:50:45.345340 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 02:50:45.345340 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 02:50:45.345340 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 02:50:45.346997 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 02:50:45.346997 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 02:50:45.346997 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 02:50:45.346997 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 02:50:45.346997 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 02:50:45.346997 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 02:50:45.346997 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 02:50:45.346997 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61f94aa1-75dc-4f43-aa71-284c50dc394c could not be found. Aug 09 02:50:45.346997 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:50:45.346997 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:50:45.346997 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:50:45.346997 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:50:45.346997 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:50:45.346997 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:50:45.346997 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 02:50:45.346997 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 02:50:45.346997 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61f94aa1-75dc-4f43-aa71-284c50dc394c could not be found. Aug 09 02:50:45.346997 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:50:45.348487 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-0dc09fbd-ed9e-436f-b477-87c318e45c45 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Returning 404 to user: Instance 61f94aa1-75dc-4f43-aa71-284c50dc394c could not be found. {{(pid=124427) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 02:50:45.348487 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-0dc09fbd-ed9e-436f-b477-87c318e45c45 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "GET /compute/v2.1/servers/61f94aa1-75dc-4f43-aa71-284c50dc394c" status: 404 len: 111 microversion: 2.1 time: 0.031628 Aug 09 02:50:45.348487 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 557/1085] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:50:45 2022] GET /compute/v2.1/servers/61f94aa1-75dc-4f43-aa71-284c50dc394c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 02:50:46.669884 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-5244d889-f920-4415-a300-832afc932686 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] Calling method '.version_select at 0x7fb0a03eaaf0>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:50:46.696603 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-5244d889-f920-4415-a300-832afc932686 tempest-TestVolumeBootPattern-1127083574 tempest-TestVolumeBootPattern-1127083574-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-93674777" status: 202 len: 0 microversion: 2.1 time: 0.033148 Aug 09 02:50:46.697227 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 529/1086] 10.222.0.20 () {58 vars in 1257 bytes} [Tue Aug 9 02:50:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-93674777 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 02:50:57.269018 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-46d9c20f-a051-4568-9b69-890c683eaef5 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "61152a06-5acc-4869-aacc-03f39ad55e2c", "device": "/dev/sdb"}} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:50:57.275059 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-46d9c20f-a051-4568-9b69-890c683eaef5 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] [instance: b6c735ed-12c9-45e8-b664-b1531b362775] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:50:57.278831 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:50:57.279877 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_cell1:SELECT=8 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:50:57.286204 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-46d9c20f-a051-4568-9b69-890c683eaef5 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:57.286745 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-46d9c20f-a051-4568-9b69-890c683eaef5 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:57.287194 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-46d9c20f-a051-4568-9b69-890c683eaef5 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:57.287898 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-46d9c20f-a051-4568-9b69-890c683eaef5 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:50:57.288345 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-46d9c20f-a051-4568-9b69-890c683eaef5 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:50:57.288756 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-46d9c20f-a051-4568-9b69-890c683eaef5 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:50:57.580855 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-46d9c20f-a051-4568-9b69-890c683eaef5 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] 10.222.0.20 "POST /compute/v2.1/servers/b6c735ed-12c9-45e8-b664-b1531b362775/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.315713 Aug 09 02:50:57.581491 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 558/1087] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Aug 9 02:50:57 2022] POST /compute/v2.1/servers/b6c735ed-12c9-45e8-b664-b1531b362775/os-volume_attachments => generated 194 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:51:18.372933 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_cell1:SELECT=14 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:51:18.373769 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:51:18.378499 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-8e2aac6d-bc5f-4321-8377-507b06a0ce24 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:51:18.378994 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-8e2aac6d-bc5f-4321-8377-507b06a0ce24 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] [instance: b6c735ed-12c9-45e8-b664-b1531b362775] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:51:18.388291 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8e2aac6d-bc5f-4321-8377-507b06a0ce24 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:51:18.388773 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8e2aac6d-bc5f-4321-8377-507b06a0ce24 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:51:18.389219 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8e2aac6d-bc5f-4321-8377-507b06a0ce24 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:51:18.389888 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8e2aac6d-bc5f-4321-8377-507b06a0ce24 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:51:18.390371 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8e2aac6d-bc5f-4321-8377-507b06a0ce24 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:51:18.390790 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-8e2aac6d-bc5f-4321-8377-507b06a0ce24 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:51:18.477567 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.objects.instance [None req-8e2aac6d-bc5f-4321-8377-507b06a0ce24 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lazy-loading 'services' on Instance uuid b6c735ed-12c9-45e8-b664-b1531b362775 {{(pid=124425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 02:51:18.551027 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-8e2aac6d-bc5f-4321-8377-507b06a0ce24 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b6c735ed-12c9-45e8-b664-b1531b362775/os-volume_attachments/61152a06-5acc-4869-aacc-03f39ad55e2c" status: 202 len: 0 microversion: 2.1 time: 0.179446 Aug 09 02:51:18.551773 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 530/1088] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Aug 9 02:51:18 2022] DELETE /compute/v2.1/servers/b6c735ed-12c9-45e8-b664-b1531b362775/os-volume_attachments/61152a06-5acc-4869-aacc-03f39ad55e2c => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 02:51:19.686482 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-a3c9cf27-2d7d-4e38-b1c3-a31aa54250c7 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:51:19.687008 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-a3c9cf27-2d7d-4e38-b1c3-a31aa54250c7 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] [instance: b6c735ed-12c9-45e8-b664-b1531b362775] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:51:19.690686 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_api:SELECT=2 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:51:19.691392 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:51:19.700015 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a3c9cf27-2d7d-4e38-b1c3-a31aa54250c7 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:51:19.700498 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a3c9cf27-2d7d-4e38-b1c3-a31aa54250c7 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:51:19.700931 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a3c9cf27-2d7d-4e38-b1c3-a31aa54250c7 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:51:19.701618 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a3c9cf27-2d7d-4e38-b1c3-a31aa54250c7 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:51:19.702065 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a3c9cf27-2d7d-4e38-b1c3-a31aa54250c7 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:51:19.702510 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-a3c9cf27-2d7d-4e38-b1c3-a31aa54250c7 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:51:19.728270 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-a3c9cf27-2d7d-4e38-b1c3-a31aa54250c7 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] [instance: b6c735ed-12c9-45e8-b664-b1531b362775] Going to try to terminate instance {{(pid=124427) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 02:51:19.814759 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-a3c9cf27-2d7d-4e38-b1c3-a31aa54250c7 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b6c735ed-12c9-45e8-b664-b1531b362775" status: 204 len: 0 microversion: 2.1 time: 0.134170 Aug 09 02:51:19.815568 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 559/1089] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 9 02:51:19 2022] DELETE /compute/v2.1/servers/b6c735ed-12c9-45e8-b664-b1531b362775 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 02:51:19.824954 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-70177ecf-8a9a-4972-a452-3fa95d990747 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:51:19.825668 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-70177ecf-8a9a-4972-a452-3fa95d990747 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] [instance: b6c735ed-12c9-45e8-b664-b1531b362775] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:51:19.831967 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-70177ecf-8a9a-4972-a452-3fa95d990747 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:51:19.832444 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-70177ecf-8a9a-4972-a452-3fa95d990747 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:51:19.832868 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-70177ecf-8a9a-4972-a452-3fa95d990747 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:51:19.833536 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-70177ecf-8a9a-4972-a452-3fa95d990747 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:51:19.833972 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-70177ecf-8a9a-4972-a452-3fa95d990747 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:51:19.834428 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-70177ecf-8a9a-4972-a452-3fa95d990747 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:51:19.972114 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-70177ecf-8a9a-4972-a452-3fa95d990747 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5f6c1a1f07409483d732db05256f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd488e2c8749640a0b3a9b0037051ff12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:51:19.980147 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-70177ecf-8a9a-4972-a452-3fa95d990747 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] 10.222.0.20 "GET /compute/v2.1/servers/b6c735ed-12c9-45e8-b664-b1531b362775" status: 200 len: 1514 microversion: 2.1 time: 0.160022 Aug 09 02:51:19.980708 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 531/1090] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:51:19 2022] GET /compute/v2.1/servers/b6c735ed-12c9-45e8-b664-b1531b362775 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:51:21.006357 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-46366915-0d0e-49c8-b858-1ab7d340d1f0 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:51:21.007514 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-46366915-0d0e-49c8-b858-1ab7d340d1f0 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] [instance: b6c735ed-12c9-45e8-b664-b1531b362775] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:51:21.018326 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-46366915-0d0e-49c8-b858-1ab7d340d1f0 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:51:21.019135 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-46366915-0d0e-49c8-b858-1ab7d340d1f0 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:51:21.019860 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-46366915-0d0e-49c8-b858-1ab7d340d1f0 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:51:21.021003 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-46366915-0d0e-49c8-b858-1ab7d340d1f0 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:51:21.021753 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-46366915-0d0e-49c8-b858-1ab7d340d1f0 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:51:21.022520 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-46366915-0d0e-49c8-b858-1ab7d340d1f0 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:51:21.155280 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-46366915-0d0e-49c8-b858-1ab7d340d1f0 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5f6c1a1f07409483d732db05256f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd488e2c8749640a0b3a9b0037051ff12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:51:21.164642 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-46366915-0d0e-49c8-b858-1ab7d340d1f0 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] 10.222.0.20 "GET /compute/v2.1/servers/b6c735ed-12c9-45e8-b664-b1531b362775" status: 200 len: 1514 microversion: 2.1 time: 0.165527 Aug 09 02:51:21.165457 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 560/1091] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:51:20 2022] GET /compute/v2.1/servers/b6c735ed-12c9-45e8-b664-b1531b362775 => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:51:22.187324 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-9a5b80ea-fedf-450a-be98-32bdd15f395b tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:51:22.188117 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-9a5b80ea-fedf-450a-be98-32bdd15f395b tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] [instance: b6c735ed-12c9-45e8-b664-b1531b362775] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:51:22.195739 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9a5b80ea-fedf-450a-be98-32bdd15f395b tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:51:22.196238 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9a5b80ea-fedf-450a-be98-32bdd15f395b tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:51:22.196909 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9a5b80ea-fedf-450a-be98-32bdd15f395b tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:51:22.197721 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9a5b80ea-fedf-450a-be98-32bdd15f395b tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:51:22.198511 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9a5b80ea-fedf-450a-be98-32bdd15f395b tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:51:22.198934 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9a5b80ea-fedf-450a-be98-32bdd15f395b tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:51:22.231804 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9a5b80ea-fedf-450a-be98-32bdd15f395b tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:51:22.232280 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9a5b80ea-fedf-450a-be98-32bdd15f395b tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:51:22.232707 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-9a5b80ea-fedf-450a-be98-32bdd15f395b tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:51:22.233146 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.objects.instance [None req-9a5b80ea-fedf-450a-be98-32bdd15f395b tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lazy-loading 'fault' on Instance uuid b6c735ed-12c9-45e8-b664-b1531b362775 {{(pid=124427) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 02:51:22.242774 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [req-317eba9d-6d56-495f-be51-bfe4ece5e461 req-1cc05308-870c-4836-b141-1f03973ca0ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6c735ed-12c9-45e8-b664-b1531b362775", "name": "network-vif-deleted", "tag": "d301c67a-1ae0-4f8f-aa01-2dd857e5ed86"}]} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:51:22.252301 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-317eba9d-6d56-495f-be51-bfe4ece5e461 req-1cc05308-870c-4836-b141-1f03973ca0ec service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:51:22.252770 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-317eba9d-6d56-495f-be51-bfe4ece5e461 req-1cc05308-870c-4836-b141-1f03973ca0ec service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:51:22.253190 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [req-317eba9d-6d56-495f-be51-bfe4ece5e461 req-1cc05308-870c-4836-b141-1f03973ca0ec service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:51:22.265982 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.compute.server_external_events [req-317eba9d-6d56-495f-be51-bfe4ece5e461 req-1cc05308-870c-4836-b141-1f03973ca0ec service nova] Creating event network-vif-deleted:d301c67a-1ae0-4f8f-aa01-2dd857e5ed86 for instance b6c735ed-12c9-45e8-b664-b1531b362775 on hv-cinder-85246 Aug 09 02:51:22.270974 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [req-317eba9d-6d56-495f-be51-bfe4ece5e461 req-1cc05308-870c-4836-b141-1f03973ca0ec service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.229979 Aug 09 02:51:22.271698 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 532/1092] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:51:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:51:22.275405 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-9a5b80ea-fedf-450a-be98-32bdd15f395b tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5f6c1a1f07409483d732db05256f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd488e2c8749640a0b3a9b0037051ff12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:51:22.282975 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-9a5b80ea-fedf-450a-be98-32bdd15f395b tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] 10.222.0.20 "GET /compute/v2.1/servers/b6c735ed-12c9-45e8-b664-b1531b362775" status: 200 len: 1309 microversion: 2.1 time: 0.100815 Aug 09 02:51:22.283521 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 561/1093] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:51:22 2022] GET /compute/v2.1/servers/b6c735ed-12c9-45e8-b664-b1531b362775 => generated 1309 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:51:23.308538 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-abe87377-98f6-47ac-a79d-b5f3bc41cd50 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:51:23.309232 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-abe87377-98f6-47ac-a79d-b5f3bc41cd50 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] [instance: b6c735ed-12c9-45e8-b664-b1531b362775] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:51:23.315934 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-abe87377-98f6-47ac-a79d-b5f3bc41cd50 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:51:23.316416 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-abe87377-98f6-47ac-a79d-b5f3bc41cd50 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:51:23.316844 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-abe87377-98f6-47ac-a79d-b5f3bc41cd50 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:51:23.317520 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-abe87377-98f6-47ac-a79d-b5f3bc41cd50 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:51:23.317935 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-abe87377-98f6-47ac-a79d-b5f3bc41cd50 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:51:23.318420 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-abe87377-98f6-47ac-a79d-b5f3bc41cd50 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:51:23.331884 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.wsgi [None req-abe87377-98f6-47ac-a79d-b5f3bc41cd50 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] HTTP exception thrown: Instance b6c735ed-12c9-45e8-b664-b1531b362775 could not be found. Aug 09 02:51:23.333480 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-abe87377-98f6-47ac-a79d-b5f3bc41cd50 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Request method failure captured: Aug 09 02:51:23.333480 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: request: GET /compute/v2.1/servers/b6c735ed-12c9-45e8-b664-b1531b362775 HTTP/1.1 Aug 09 02:51:23.333480 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Accept: application/json Aug 09 02:51:23.333480 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Accept-Encoding: identity Aug 09 02:51:23.333480 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Connection: close Aug 09 02:51:23.333480 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Content-Length: 0 Aug 09 02:51:23.333480 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Content-Type: application/json Aug 09 02:51:23.333480 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Host: 10.222.0.20 Aug 09 02:51:23.333480 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Openstack-System-Scope: None Aug 09 02:51:23.333480 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: User-Agent: python-urllib3/1.26.11 Aug 09 02:51:23.333480 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Auth-Token: gAAAAABi8ctub6jQA90e7USkvqGYy2-S-eUxFI9WqMmNPzrvSkMvG7G1FZtBk_1HRJk7mdP_Ihm8k-FvDj67eWnKeD_ZvFj7l4XomTXYcNoRM9QrB28Qp_FYHlVtv62XYZy6N5aPXgakBBleBNfCU95zZ9b0DfMYqSDQS-SHO8psTWuFngAHWPE Aug 09 02:51:23.333480 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Domain-Id: None Aug 09 02:51:23.333480 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Domain-Name: None Aug 09 02:51:23.333480 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Identity-Status: Confirmed Aug 09 02:51:23.333480 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Is-Admin-Project: True Aug 09 02:51:23.333480 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Domain-Id: default Aug 09 02:51:23.333480 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Domain-Name: Default Aug 09 02:51:23.333480 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Id: d488e2c8749640a0b3a9b0037051ff12 Aug 09 02:51:23.333480 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Project-Name: tempest-VolumesSnapshotTestJSON-851994339 Aug 09 02:51:23.333480 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Role: reader,member Aug 09 02:51:23.333480 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Roles: reader,member Aug 09 02:51:23.335271 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d488e2c8749640a0b3a9b0037051ff12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d488e2c8749640a0b3a9b0037051ff12"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d488e2c8749640a0b3a9b0037051ff12"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d488e2c8749640a0b3a9b0037051ff12"}]}] Aug 09 02:51:23.335271 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant: tempest-VolumesSnapshotTestJSON-851994339 Aug 09 02:51:23.335271 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant-Id: d488e2c8749640a0b3a9b0037051ff12 Aug 09 02:51:23.335271 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-851994339 Aug 09 02:51:23.335271 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User: tempest-VolumesSnapshotTestJSON-851994339-project Aug 09 02:51:23.335271 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Domain-Id: default Aug 09 02:51:23.335271 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Domain-Name: Default Aug 09 02:51:23.335271 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Id: 9e5f6c1a1f07409483d732db05256f1b Aug 09 02:51:23.335271 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: X-User-Name: tempest-VolumesSnapshotTestJSON-851994339-project Aug 09 02:51:23.335271 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: method: > Aug 09 02:51:23.335271 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: exception: Instance b6c735ed-12c9-45e8-b664-b1531b362775 could not be found. Aug 09 02:51:23.335271 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: action_args: {'id': 'b6c735ed-12c9-45e8-b664-b1531b362775'} Aug 09 02:51:23.336472 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 02:51:23.336472 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:51:23.336472 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 02:51:23.336472 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 02:51:23.336472 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 02:51:23.336472 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 02:51:23.336472 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 02:51:23.336472 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 02:51:23.336472 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 02:51:23.336472 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 02:51:23.336472 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6c735ed-12c9-45e8-b664-b1531b362775 could not be found. Aug 09 02:51:23.336472 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:51:23.336472 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:51:23.336472 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:51:23.336472 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:51:23.336472 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:51:23.336472 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:51:23.336472 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 02:51:23.336472 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 02:51:23.336472 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 02:51:23.338195 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 02:51:23.338195 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 02:51:23.338195 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 02:51:23.338195 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 02:51:23.338195 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 02:51:23.338195 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 02:51:23.338195 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 02:51:23.338195 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6c735ed-12c9-45e8-b664-b1531b362775 could not be found. Aug 09 02:51:23.338195 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:51:23.338195 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:51:23.338195 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:51:23.338195 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:51:23.338195 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:51:23.338195 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:51:23.338195 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 02:51:23.338195 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 02:51:23.338195 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6c735ed-12c9-45e8-b664-b1531b362775 could not be found. Aug 09 02:51:23.338195 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: ERROR nova.api.openstack.wsgi Aug 09 02:51:23.339748 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-abe87377-98f6-47ac-a79d-b5f3bc41cd50 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Returning 404 to user: Instance b6c735ed-12c9-45e8-b664-b1531b362775 could not be found. {{(pid=124425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 02:51:23.339748 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-abe87377-98f6-47ac-a79d-b5f3bc41cd50 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] 10.222.0.20 "GET /compute/v2.1/servers/b6c735ed-12c9-45e8-b664-b1531b362775" status: 404 len: 111 microversion: 2.1 time: 0.033667 Aug 09 02:51:23.339748 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 533/1094] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:51:23 2022] GET /compute/v2.1/servers/b6c735ed-12c9-45e8-b664-b1531b362775 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 02:51:31.247524 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-6dcc997c-9865-496a-9a9a-06858fbcc2a1 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1004781456", "imageRef": "04a06944-b2a8-4a65-b2a6-7ed3ff18a627", "flavorRef": "452", "networks": [{"uuid": "cfd0a97e-acef-4bf5-b59f-a3b4522b722e"}]}} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:51:31.304713 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.network.neutron [None req-6dcc997c-9865-496a-9a9a-06858fbcc2a1 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] validate_networks() for [('cfd0a97e-acef-4bf5-b59f-a3b4522b722e', None, None, None, None, None)] {{(pid=124427) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 02:51:32.029566 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.virt.hardware [None req-6dcc997c-9865-496a-9a9a-06858fbcc2a1 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Flavor limits 0:0:0 {{(pid=124427) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 02:51:32.029978 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.virt.hardware [None req-6dcc997c-9865-496a-9a9a-06858fbcc2a1 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Image limits 0:0:0 {{(pid=124427) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 02:51:32.030483 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.virt.hardware [None req-6dcc997c-9865-496a-9a9a-06858fbcc2a1 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Flavor pref 0:0:0 {{(pid=124427) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 02:51:32.030886 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.virt.hardware [None req-6dcc997c-9865-496a-9a9a-06858fbcc2a1 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Image pref 0:0:0 {{(pid=124427) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 02:51:32.031286 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.virt.hardware [None req-6dcc997c-9865-496a-9a9a-06858fbcc2a1 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124427) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 02:51:32.040652 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6dcc997c-9865-496a-9a9a-06858fbcc2a1 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:51:32.041119 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6dcc997c-9865-496a-9a9a-06858fbcc2a1 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:51:32.041545 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6dcc997c-9865-496a-9a9a-06858fbcc2a1 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:51:32.042364 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6dcc997c-9865-496a-9a9a-06858fbcc2a1 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:51:32.042810 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6dcc997c-9865-496a-9a9a-06858fbcc2a1 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:51:32.043221 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-6dcc997c-9865-496a-9a9a-06858fbcc2a1 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:51:32.061299 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.quota [None req-6dcc997c-9865-496a-9a9a-06858fbcc2a1 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Getting quotas for project d488e2c8749640a0b3a9b0037051ff12. Resources: {'cores', 'ram', 'instances'} {{(pid=124427) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 02:51:32.065497 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.quota [None req-6dcc997c-9865-496a-9a9a-06858fbcc2a1 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Getting quotas for user 9e5f6c1a1f07409483d732db05256f1b and project d488e2c8749640a0b3a9b0037051ff12. Resources: {'cores', 'ram', 'instances'} {{(pid=124427) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 02:51:32.076868 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-6dcc997c-9865-496a-9a9a-06858fbcc2a1 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Going to run 1 instances... {{(pid=124427) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 02:51:32.079120 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-6dcc997c-9865-496a-9a9a-06858fbcc2a1 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] [instance: 54461aa4-0a89-4a9c-930b-8c6b84e4d24f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='04a06944-b2a8-4a65-b2a6-7ed3ff18a627',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124427) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 02:51:32.127056 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-6dcc997c-9865-496a-9a9a-06858fbcc2a1 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.883481 Aug 09 02:51:32.127688 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 562/1095] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Aug 9 02:51:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 885 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 02:51:32.138751 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-668212c0-d44e-4944-9809-3b16e7ae8758 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:51:32.139341 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-668212c0-d44e-4944-9809-3b16e7ae8758 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] [instance: 54461aa4-0a89-4a9c-930b-8c6b84e4d24f] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:51:32.193477 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-668212c0-d44e-4944-9809-3b16e7ae8758 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5f6c1a1f07409483d732db05256f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd488e2c8749640a0b3a9b0037051ff12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:51:32.200452 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-668212c0-d44e-4944-9809-3b16e7ae8758 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] 10.222.0.20 "GET /compute/v2.1/servers/54461aa4-0a89-4a9c-930b-8c6b84e4d24f" status: 200 len: 1219 microversion: 2.1 time: 0.065734 Aug 09 02:51:32.201026 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 534/1096] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:51:32 2022] GET /compute/v2.1/servers/54461aa4-0a89-4a9c-930b-8c6b84e4d24f => generated 1219 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:51:33.221047 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-3fb81dae-23db-439d-8398-4da87c6bf601 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:51:33.221692 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-3fb81dae-23db-439d-8398-4da87c6bf601 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] [instance: 54461aa4-0a89-4a9c-930b-8c6b84e4d24f] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:51:33.228376 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3fb81dae-23db-439d-8398-4da87c6bf601 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:51:33.228849 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3fb81dae-23db-439d-8398-4da87c6bf601 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:51:33.229273 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3fb81dae-23db-439d-8398-4da87c6bf601 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:51:33.230058 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3fb81dae-23db-439d-8398-4da87c6bf601 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:51:33.230537 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3fb81dae-23db-439d-8398-4da87c6bf601 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:51:33.230949 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-3fb81dae-23db-439d-8398-4da87c6bf601 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:51:33.331233 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-3fb81dae-23db-439d-8398-4da87c6bf601 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5f6c1a1f07409483d732db05256f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd488e2c8749640a0b3a9b0037051ff12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:51:33.338987 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-3fb81dae-23db-439d-8398-4da87c6bf601 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] 10.222.0.20 "GET /compute/v2.1/servers/54461aa4-0a89-4a9c-930b-8c6b84e4d24f" status: 200 len: 1279 microversion: 2.1 time: 0.122404 Aug 09 02:51:33.344363 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 563/1097] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:51:33 2022] GET /compute/v2.1/servers/54461aa4-0a89-4a9c-930b-8c6b84e4d24f => generated 1279 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:51:34.360135 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-10e5e5a0-48c4-42c8-aec6-6abd1feb8bc1 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:51:34.360752 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-10e5e5a0-48c4-42c8-aec6-6abd1feb8bc1 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] [instance: 54461aa4-0a89-4a9c-930b-8c6b84e4d24f] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:51:34.363180 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:51:34.370112 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-10e5e5a0-48c4-42c8-aec6-6abd1feb8bc1 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:51:34.370647 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-10e5e5a0-48c4-42c8-aec6-6abd1feb8bc1 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:51:34.371095 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-10e5e5a0-48c4-42c8-aec6-6abd1feb8bc1 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:51:34.371835 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-10e5e5a0-48c4-42c8-aec6-6abd1feb8bc1 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:51:34.372264 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-10e5e5a0-48c4-42c8-aec6-6abd1feb8bc1 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:51:34.372720 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-10e5e5a0-48c4-42c8-aec6-6abd1feb8bc1 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:51:34.572585 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-10e5e5a0-48c4-42c8-aec6-6abd1feb8bc1 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5f6c1a1f07409483d732db05256f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd488e2c8749640a0b3a9b0037051ff12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:51:34.580996 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-10e5e5a0-48c4-42c8-aec6-6abd1feb8bc1 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] 10.222.0.20 "GET /compute/v2.1/servers/54461aa4-0a89-4a9c-930b-8c6b84e4d24f" status: 200 len: 1319 microversion: 2.1 time: 0.225196 Aug 09 02:51:34.581708 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 535/1098] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:51:34 2022] GET /compute/v2.1/servers/54461aa4-0a89-4a9c-930b-8c6b84e4d24f => generated 1319 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:51:34.624595 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [req-85fdf93f-1908-4e36-8deb-59cc572da24c req-d6e40018-6946-46ad-825e-adf938533080 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54461aa4-0a89-4a9c-930b-8c6b84e4d24f", "tag": "3e842365-2045-4a26-bf6c-934b3434cdce"}]} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:51:34.635654 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-85fdf93f-1908-4e36-8deb-59cc572da24c req-d6e40018-6946-46ad-825e-adf938533080 service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:51:34.636260 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-85fdf93f-1908-4e36-8deb-59cc572da24c req-d6e40018-6946-46ad-825e-adf938533080 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:51:34.636677 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-85fdf93f-1908-4e36-8deb-59cc572da24c req-d6e40018-6946-46ad-825e-adf938533080 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:51:34.653635 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.compute.server_external_events [req-85fdf93f-1908-4e36-8deb-59cc572da24c req-d6e40018-6946-46ad-825e-adf938533080 service nova] Creating event network-changed:3e842365-2045-4a26-bf6c-934b3434cdce for instance 54461aa4-0a89-4a9c-930b-8c6b84e4d24f on hv-cinder-85246 Aug 09 02:51:34.658648 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [req-85fdf93f-1908-4e36-8deb-59cc572da24c req-d6e40018-6946-46ad-825e-adf938533080 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037768 Aug 09 02:51:34.659516 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 564/1099] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:51:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:51:35.606760 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-e93b9dc6-25ae-4be7-b72a-374db034c059 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:51:35.607285 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-e93b9dc6-25ae-4be7-b72a-374db034c059 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] [instance: 54461aa4-0a89-4a9c-930b-8c6b84e4d24f] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:51:35.614824 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e93b9dc6-25ae-4be7-b72a-374db034c059 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:51:35.615330 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e93b9dc6-25ae-4be7-b72a-374db034c059 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:51:35.615786 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e93b9dc6-25ae-4be7-b72a-374db034c059 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:51:35.616521 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e93b9dc6-25ae-4be7-b72a-374db034c059 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:51:35.616994 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e93b9dc6-25ae-4be7-b72a-374db034c059 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:51:35.617435 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e93b9dc6-25ae-4be7-b72a-374db034c059 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:51:35.753595 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-e93b9dc6-25ae-4be7-b72a-374db034c059 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5f6c1a1f07409483d732db05256f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd488e2c8749640a0b3a9b0037051ff12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:51:35.761378 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-e93b9dc6-25ae-4be7-b72a-374db034c059 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] 10.222.0.20 "GET /compute/v2.1/servers/54461aa4-0a89-4a9c-930b-8c6b84e4d24f" status: 200 len: 1319 microversion: 2.1 time: 0.160331 Aug 09 02:51:35.761942 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 536/1100] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:51:35 2022] GET /compute/v2.1/servers/54461aa4-0a89-4a9c-930b-8c6b84e4d24f => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:51:36.785727 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-77b787da-cf21-45ae-9c96-5fa788144e0b tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:51:36.786564 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-77b787da-cf21-45ae-9c96-5fa788144e0b tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] [instance: 54461aa4-0a89-4a9c-930b-8c6b84e4d24f] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:51:36.794294 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-77b787da-cf21-45ae-9c96-5fa788144e0b tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:51:36.794868 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-77b787da-cf21-45ae-9c96-5fa788144e0b tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:51:36.795295 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-77b787da-cf21-45ae-9c96-5fa788144e0b tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:51:36.796004 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-77b787da-cf21-45ae-9c96-5fa788144e0b tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:51:36.796549 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-77b787da-cf21-45ae-9c96-5fa788144e0b tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:51:36.796969 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-77b787da-cf21-45ae-9c96-5fa788144e0b tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:51:36.940070 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-77b787da-cf21-45ae-9c96-5fa788144e0b tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5f6c1a1f07409483d732db05256f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd488e2c8749640a0b3a9b0037051ff12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:51:36.947950 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-77b787da-cf21-45ae-9c96-5fa788144e0b tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] 10.222.0.20 "GET /compute/v2.1/servers/54461aa4-0a89-4a9c-930b-8c6b84e4d24f" status: 200 len: 1319 microversion: 2.1 time: 0.169073 Aug 09 02:51:36.948571 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 565/1101] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:51:36 2022] GET /compute/v2.1/servers/54461aa4-0a89-4a9c-930b-8c6b84e4d24f => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:51:37.972421 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-e3639d04-98fa-433b-977e-2a6cbacbdd02 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:51:37.973367 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-e3639d04-98fa-433b-977e-2a6cbacbdd02 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] [instance: 54461aa4-0a89-4a9c-930b-8c6b84e4d24f] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:51:37.984714 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e3639d04-98fa-433b-977e-2a6cbacbdd02 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:51:37.985514 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e3639d04-98fa-433b-977e-2a6cbacbdd02 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:51:37.986248 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e3639d04-98fa-433b-977e-2a6cbacbdd02 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:51:37.987441 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e3639d04-98fa-433b-977e-2a6cbacbdd02 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:51:37.988200 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e3639d04-98fa-433b-977e-2a6cbacbdd02 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:51:37.988955 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e3639d04-98fa-433b-977e-2a6cbacbdd02 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:51:38.131200 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-e3639d04-98fa-433b-977e-2a6cbacbdd02 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5f6c1a1f07409483d732db05256f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd488e2c8749640a0b3a9b0037051ff12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:51:38.142441 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-e3639d04-98fa-433b-977e-2a6cbacbdd02 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] 10.222.0.20 "GET /compute/v2.1/servers/54461aa4-0a89-4a9c-930b-8c6b84e4d24f" status: 200 len: 1319 microversion: 2.1 time: 0.176353 Aug 09 02:51:38.143192 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 537/1102] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:51:37 2022] GET /compute/v2.1/servers/54461aa4-0a89-4a9c-930b-8c6b84e4d24f => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:51:39.170650 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-e68a3ff8-f7ad-487c-acf6-925013dbfbe1 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:51:39.171806 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-e68a3ff8-f7ad-487c-acf6-925013dbfbe1 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] [instance: 54461aa4-0a89-4a9c-930b-8c6b84e4d24f] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:51:39.182525 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e68a3ff8-f7ad-487c-acf6-925013dbfbe1 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:51:39.183326 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e68a3ff8-f7ad-487c-acf6-925013dbfbe1 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:51:39.184070 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e68a3ff8-f7ad-487c-acf6-925013dbfbe1 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:51:39.185196 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e68a3ff8-f7ad-487c-acf6-925013dbfbe1 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:51:39.185940 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e68a3ff8-f7ad-487c-acf6-925013dbfbe1 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:51:39.186689 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-e68a3ff8-f7ad-487c-acf6-925013dbfbe1 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:51:39.323896 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-e68a3ff8-f7ad-487c-acf6-925013dbfbe1 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5f6c1a1f07409483d732db05256f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd488e2c8749640a0b3a9b0037051ff12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:51:39.332070 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-e68a3ff8-f7ad-487c-acf6-925013dbfbe1 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] 10.222.0.20 "GET /compute/v2.1/servers/54461aa4-0a89-4a9c-930b-8c6b84e4d24f" status: 200 len: 1319 microversion: 2.1 time: 0.168073 Aug 09 02:51:39.332640 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 566/1103] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:51:39 2022] GET /compute/v2.1/servers/54461aa4-0a89-4a9c-930b-8c6b84e4d24f => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:51:40.353518 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-d4d0fe21-f5b1-4223-abf5-4d86fcb73ad4 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:51:40.354067 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-d4d0fe21-f5b1-4223-abf5-4d86fcb73ad4 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] [instance: 54461aa4-0a89-4a9c-930b-8c6b84e4d24f] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:51:40.361280 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d4d0fe21-f5b1-4223-abf5-4d86fcb73ad4 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:51:40.361770 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d4d0fe21-f5b1-4223-abf5-4d86fcb73ad4 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:51:40.362250 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d4d0fe21-f5b1-4223-abf5-4d86fcb73ad4 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:51:40.362936 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d4d0fe21-f5b1-4223-abf5-4d86fcb73ad4 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:51:40.363408 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d4d0fe21-f5b1-4223-abf5-4d86fcb73ad4 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:51:40.363821 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-d4d0fe21-f5b1-4223-abf5-4d86fcb73ad4 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:51:40.497170 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-d4d0fe21-f5b1-4223-abf5-4d86fcb73ad4 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5f6c1a1f07409483d732db05256f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd488e2c8749640a0b3a9b0037051ff12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:51:40.505242 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-d4d0fe21-f5b1-4223-abf5-4d86fcb73ad4 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] 10.222.0.20 "GET /compute/v2.1/servers/54461aa4-0a89-4a9c-930b-8c6b84e4d24f" status: 200 len: 1319 microversion: 2.1 time: 0.156136 Aug 09 02:51:40.506115 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 538/1104] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:51:40 2022] GET /compute/v2.1/servers/54461aa4-0a89-4a9c-930b-8c6b84e4d24f => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:51:40.566650 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [req-40ec0d97-4460-415b-bcf8-35dd1495befa req-4ebe6f4b-90ef-4c9d-a8cf-7f2b1e296c43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54461aa4-0a89-4a9c-930b-8c6b84e4d24f", "name": "network-vif-plugged", "status": "completed", "tag": "3e842365-2045-4a26-bf6c-934b3434cdce"}]} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:51:40.576668 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-40ec0d97-4460-415b-bcf8-35dd1495befa req-4ebe6f4b-90ef-4c9d-a8cf-7f2b1e296c43 service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:51:40.577220 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-40ec0d97-4460-415b-bcf8-35dd1495befa req-4ebe6f4b-90ef-4c9d-a8cf-7f2b1e296c43 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:51:40.577714 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-40ec0d97-4460-415b-bcf8-35dd1495befa req-4ebe6f4b-90ef-4c9d-a8cf-7f2b1e296c43 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:51:40.589201 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.compute.server_external_events [req-40ec0d97-4460-415b-bcf8-35dd1495befa req-4ebe6f4b-90ef-4c9d-a8cf-7f2b1e296c43 service nova] Creating event network-vif-plugged:3e842365-2045-4a26-bf6c-934b3434cdce for instance 54461aa4-0a89-4a9c-930b-8c6b84e4d24f on hv-cinder-85246 Aug 09 02:51:40.594337 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [req-40ec0d97-4460-415b-bcf8-35dd1495befa req-4ebe6f4b-90ef-4c9d-a8cf-7f2b1e296c43 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094177 Aug 09 02:51:40.594921 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 567/1105] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:51:41.529480 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-3403a4c4-3c77-4fa8-be7c-618bd13c77a2 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:51:41.530531 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-3403a4c4-3c77-4fa8-be7c-618bd13c77a2 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] [instance: 54461aa4-0a89-4a9c-930b-8c6b84e4d24f] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:51:41.540985 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3403a4c4-3c77-4fa8-be7c-618bd13c77a2 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:51:41.541774 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3403a4c4-3c77-4fa8-be7c-618bd13c77a2 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:51:41.542485 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3403a4c4-3c77-4fa8-be7c-618bd13c77a2 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:51:41.543583 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3403a4c4-3c77-4fa8-be7c-618bd13c77a2 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:51:41.544154 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3403a4c4-3c77-4fa8-be7c-618bd13c77a2 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:51:41.544572 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3403a4c4-3c77-4fa8-be7c-618bd13c77a2 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:51:41.694181 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-3403a4c4-3c77-4fa8-be7c-618bd13c77a2 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5f6c1a1f07409483d732db05256f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd488e2c8749640a0b3a9b0037051ff12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:51:41.702222 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-3403a4c4-3c77-4fa8-be7c-618bd13c77a2 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] 10.222.0.20 "GET /compute/v2.1/servers/54461aa4-0a89-4a9c-930b-8c6b84e4d24f" status: 200 len: 1319 microversion: 2.1 time: 0.178903 Aug 09 02:51:41.702794 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 539/1106] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:51:41 2022] GET /compute/v2.1/servers/54461aa4-0a89-4a9c-930b-8c6b84e4d24f => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:51:42.726395 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_cell0:SELECT=2 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:51:42.727162 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_cell0:SELECT=6 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:51:42.731233 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-03e23c9a-0c7a-42a2-91eb-f019f8dacdc5 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:51:42.731958 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-03e23c9a-0c7a-42a2-91eb-f019f8dacdc5 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] [instance: 54461aa4-0a89-4a9c-930b-8c6b84e4d24f] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:51:42.739436 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-03e23c9a-0c7a-42a2-91eb-f019f8dacdc5 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:51:42.739940 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-03e23c9a-0c7a-42a2-91eb-f019f8dacdc5 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:51:42.740371 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-03e23c9a-0c7a-42a2-91eb-f019f8dacdc5 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:51:42.741051 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-03e23c9a-0c7a-42a2-91eb-f019f8dacdc5 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:51:42.741495 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-03e23c9a-0c7a-42a2-91eb-f019f8dacdc5 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:51:42.741945 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-03e23c9a-0c7a-42a2-91eb-f019f8dacdc5 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:51:42.877814 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-03e23c9a-0c7a-42a2-91eb-f019f8dacdc5 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5f6c1a1f07409483d732db05256f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd488e2c8749640a0b3a9b0037051ff12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:51:42.889404 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-03e23c9a-0c7a-42a2-91eb-f019f8dacdc5 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] 10.222.0.20 "GET /compute/v2.1/servers/54461aa4-0a89-4a9c-930b-8c6b84e4d24f" status: 200 len: 1508 microversion: 2.1 time: 0.164281 Aug 09 02:51:42.890048 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 568/1107] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:51:42 2022] GET /compute/v2.1/servers/54461aa4-0a89-4a9c-930b-8c6b84e4d24f => generated 1508 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:51:42.911324 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-3f2c2d6f-8a0a-4a3b-bf18-8e4dab91fc78 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "815a70f8-8e00-4403-bb0e-fa6c3a137bdb", "device": "/dev/sdb"}} {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:51:42.915060 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-3f2c2d6f-8a0a-4a3b-bf18-8e4dab91fc78 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] [instance: 54461aa4-0a89-4a9c-930b-8c6b84e4d24f] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:51:42.917907 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_cell0:SELECT=2 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:51:42.924466 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3f2c2d6f-8a0a-4a3b-bf18-8e4dab91fc78 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:51:42.924945 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3f2c2d6f-8a0a-4a3b-bf18-8e4dab91fc78 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:51:42.925372 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3f2c2d6f-8a0a-4a3b-bf18-8e4dab91fc78 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:51:42.926076 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3f2c2d6f-8a0a-4a3b-bf18-8e4dab91fc78 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:51:42.926551 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3f2c2d6f-8a0a-4a3b-bf18-8e4dab91fc78 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:51:42.926970 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-3f2c2d6f-8a0a-4a3b-bf18-8e4dab91fc78 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:51:43.199508 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-3f2c2d6f-8a0a-4a3b-bf18-8e4dab91fc78 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] 10.222.0.20 "POST /compute/v2.1/servers/54461aa4-0a89-4a9c-930b-8c6b84e4d24f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.293689 Aug 09 02:51:43.204709 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 540/1108] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Aug 9 02:51:42 2022] POST /compute/v2.1/servers/54461aa4-0a89-4a9c-930b-8c6b84e4d24f/os-volume_attachments => generated 194 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:52:00.664348 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-685656b5-5f7a-487c-8080-4e3f40d44db2 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:52:00.664881 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-685656b5-5f7a-487c-8080-4e3f40d44db2 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] [instance: 54461aa4-0a89-4a9c-930b-8c6b84e4d24f] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:52:00.667303 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:52:00.668169 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG dbcounter [-] [124427] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:52:00.673917 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-685656b5-5f7a-487c-8080-4e3f40d44db2 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:52:00.674512 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-685656b5-5f7a-487c-8080-4e3f40d44db2 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:52:00.674942 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-685656b5-5f7a-487c-8080-4e3f40d44db2 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:52:00.675629 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-685656b5-5f7a-487c-8080-4e3f40d44db2 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:52:00.676072 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-685656b5-5f7a-487c-8080-4e3f40d44db2 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:52:00.676484 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-685656b5-5f7a-487c-8080-4e3f40d44db2 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:52:00.761887 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.objects.instance [None req-685656b5-5f7a-487c-8080-4e3f40d44db2 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lazy-loading 'services' on Instance uuid 54461aa4-0a89-4a9c-930b-8c6b84e4d24f {{(pid=124427) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 02:52:00.835312 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-685656b5-5f7a-487c-8080-4e3f40d44db2 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] 10.222.0.20 "DELETE /compute/v2.1/servers/54461aa4-0a89-4a9c-930b-8c6b84e4d24f/os-volume_attachments/815a70f8-8e00-4403-bb0e-fa6c3a137bdb" status: 202 len: 0 microversion: 2.1 time: 0.174769 Aug 09 02:52:00.835938 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 569/1109] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Aug 9 02:52:00 2022] DELETE /compute/v2.1/servers/54461aa4-0a89-4a9c-930b-8c6b84e4d24f/os-volume_attachments/815a70f8-8e00-4403-bb0e-fa6c3a137bdb => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 02:52:01.972083 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_api:SELECT=24 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:52:01.972917 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG dbcounter [-] [124425] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:52:01.976967 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-f9e86361-fefb-4690-b822-563c7e33345d tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:52:01.977560 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-f9e86361-fefb-4690-b822-563c7e33345d tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] [instance: 54461aa4-0a89-4a9c-930b-8c6b84e4d24f] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:52:01.985234 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f9e86361-fefb-4690-b822-563c7e33345d tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:52:01.985717 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f9e86361-fefb-4690-b822-563c7e33345d tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:52:01.986123 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f9e86361-fefb-4690-b822-563c7e33345d tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:52:01.986892 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f9e86361-fefb-4690-b822-563c7e33345d tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:52:01.987344 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f9e86361-fefb-4690-b822-563c7e33345d tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:52:01.987945 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-f9e86361-fefb-4690-b822-563c7e33345d tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:52:02.013607 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-f9e86361-fefb-4690-b822-563c7e33345d tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] [instance: 54461aa4-0a89-4a9c-930b-8c6b84e4d24f] Going to try to terminate instance {{(pid=124425) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 02:52:02.092082 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-f9e86361-fefb-4690-b822-563c7e33345d tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] 10.222.0.20 "DELETE /compute/v2.1/servers/54461aa4-0a89-4a9c-930b-8c6b84e4d24f" status: 204 len: 0 microversion: 2.1 time: 0.121328 Aug 09 02:52:02.092715 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 541/1110] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 9 02:52:01 2022] DELETE /compute/v2.1/servers/54461aa4-0a89-4a9c-930b-8c6b84e4d24f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 02:52:02.102202 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-4e40cf38-8452-4299-a974-0c3b96d97593 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:52:02.102906 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-4e40cf38-8452-4299-a974-0c3b96d97593 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] [instance: 54461aa4-0a89-4a9c-930b-8c6b84e4d24f] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:52:02.109536 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4e40cf38-8452-4299-a974-0c3b96d97593 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:52:02.110018 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4e40cf38-8452-4299-a974-0c3b96d97593 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:52:02.110485 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4e40cf38-8452-4299-a974-0c3b96d97593 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:52:02.111173 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4e40cf38-8452-4299-a974-0c3b96d97593 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:52:02.111627 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4e40cf38-8452-4299-a974-0c3b96d97593 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:52:02.112048 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-4e40cf38-8452-4299-a974-0c3b96d97593 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:52:02.248200 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.policy [None req-4e40cf38-8452-4299-a974-0c3b96d97593 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5f6c1a1f07409483d732db05256f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd488e2c8749640a0b3a9b0037051ff12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124427) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:52:02.256097 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-4e40cf38-8452-4299-a974-0c3b96d97593 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] 10.222.0.20 "GET /compute/v2.1/servers/54461aa4-0a89-4a9c-930b-8c6b84e4d24f" status: 200 len: 1514 microversion: 2.1 time: 0.158710 Aug 09 02:52:02.256672 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 570/1111] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:52:02 2022] GET /compute/v2.1/servers/54461aa4-0a89-4a9c-930b-8c6b84e4d24f => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:52:03.281944 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-df7c47f4-394b-42cc-bffe-0b2db6536b53 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:52:03.283144 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-df7c47f4-394b-42cc-bffe-0b2db6536b53 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] [instance: 54461aa4-0a89-4a9c-930b-8c6b84e4d24f] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:52:03.294106 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-df7c47f4-394b-42cc-bffe-0b2db6536b53 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:52:03.295007 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-df7c47f4-394b-42cc-bffe-0b2db6536b53 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:52:03.295715 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-df7c47f4-394b-42cc-bffe-0b2db6536b53 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:52:03.296919 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-df7c47f4-394b-42cc-bffe-0b2db6536b53 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:52:03.297652 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-df7c47f4-394b-42cc-bffe-0b2db6536b53 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:52:03.298253 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-df7c47f4-394b-42cc-bffe-0b2db6536b53 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:52:03.437298 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-df7c47f4-394b-42cc-bffe-0b2db6536b53 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5f6c1a1f07409483d732db05256f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd488e2c8749640a0b3a9b0037051ff12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:52:03.445207 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-df7c47f4-394b-42cc-bffe-0b2db6536b53 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] 10.222.0.20 "GET /compute/v2.1/servers/54461aa4-0a89-4a9c-930b-8c6b84e4d24f" status: 200 len: 1514 microversion: 2.1 time: 0.170689 Aug 09 02:52:03.445785 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 542/1112] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:52:03 2022] GET /compute/v2.1/servers/54461aa4-0a89-4a9c-930b-8c6b84e4d24f => generated 1514 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:52:04.322757 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [req-1b5d27b1-589e-4988-98da-3485c1e5c1ae req-3b8c26c0-a901-45c7-a4e2-d8a5e39e9495 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54461aa4-0a89-4a9c-930b-8c6b84e4d24f", "name": "network-vif-deleted", "tag": "3e842365-2045-4a26-bf6c-934b3434cdce"}]} {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 02:52:04.332794 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-1b5d27b1-589e-4988-98da-3485c1e5c1ae req-3b8c26c0-a901-45c7-a4e2-d8a5e39e9495 service nova] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:52:04.333267 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-1b5d27b1-589e-4988-98da-3485c1e5c1ae req-3b8c26c0-a901-45c7-a4e2-d8a5e39e9495 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:52:04.333692 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [req-1b5d27b1-589e-4988-98da-3485c1e5c1ae req-3b8c26c0-a901-45c7-a4e2-d8a5e39e9495 service nova] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:52:04.345086 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.compute.server_external_events [req-1b5d27b1-589e-4988-98da-3485c1e5c1ae req-3b8c26c0-a901-45c7-a4e2-d8a5e39e9495 service nova] Creating event network-vif-deleted:3e842365-2045-4a26-bf6c-934b3434cdce for instance 54461aa4-0a89-4a9c-930b-8c6b84e4d24f on hv-cinder-85246 Aug 09 02:52:04.350052 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [req-1b5d27b1-589e-4988-98da-3485c1e5c1ae req-3b8c26c0-a901-45c7-a4e2-d8a5e39e9495 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030947 Aug 09 02:52:04.350699 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 571/1113] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 9 02:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 02:52:04.468046 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.api.openstack.wsgi [None req-e3ea90eb-eb12-411e-ae53-b8a12688df36 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Calling method '>' {{(pid=124425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:52:04.468754 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.compute.api [None req-e3ea90eb-eb12-411e-ae53-b8a12688df36 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] [instance: 54461aa4-0a89-4a9c-930b-8c6b84e4d24f] Fetching instance by UUID {{(pid=124425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:52:04.475796 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e3ea90eb-eb12-411e-ae53-b8a12688df36 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:52:04.476289 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e3ea90eb-eb12-411e-ae53-b8a12688df36 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:52:04.476725 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e3ea90eb-eb12-411e-ae53-b8a12688df36 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:52:04.477424 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e3ea90eb-eb12-411e-ae53-b8a12688df36 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:52:04.477847 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e3ea90eb-eb12-411e-ae53-b8a12688df36 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:52:04.478337 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e3ea90eb-eb12-411e-ae53-b8a12688df36 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:52:04.515633 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e3ea90eb-eb12-411e-ae53-b8a12688df36 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:52:04.516028 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e3ea90eb-eb12-411e-ae53-b8a12688df36 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:52:04.516472 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG oslo_concurrency.lockutils [None req-e3ea90eb-eb12-411e-ae53-b8a12688df36 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:52:04.516918 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.objects.instance [None req-e3ea90eb-eb12-411e-ae53-b8a12688df36 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lazy-loading 'fault' on Instance uuid 54461aa4-0a89-4a9c-930b-8c6b84e4d24f {{(pid=124425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 02:52:04.560620 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: DEBUG nova.policy [None req-e3ea90eb-eb12-411e-ae53-b8a12688df36 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5f6c1a1f07409483d732db05256f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd488e2c8749640a0b3a9b0037051ff12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 02:52:04.568325 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO nova.api.openstack.requestlog [None req-e3ea90eb-eb12-411e-ae53-b8a12688df36 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] 10.222.0.20 "GET /compute/v2.1/servers/54461aa4-0a89-4a9c-930b-8c6b84e4d24f" status: 200 len: 1309 microversion: 2.1 time: 0.104401 Aug 09 02:52:04.568869 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: [pid: 124425|app: 0|req: 543/1114] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:52:04 2022] GET /compute/v2.1/servers/54461aa4-0a89-4a9c-930b-8c6b84e4d24f => generated 1309 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 02:52:05.594709 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-df122c77-b0ba-436c-876d-152fe11fe504 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Calling method '>' {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 02:52:05.595798 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.compute.api [None req-df122c77-b0ba-436c-876d-152fe11fe504 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] [instance: 54461aa4-0a89-4a9c-930b-8c6b84e4d24f] Fetching instance by UUID {{(pid=124427) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 02:52:05.606220 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-df122c77-b0ba-436c-876d-152fe11fe504 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:52:05.607076 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-df122c77-b0ba-436c-876d-152fe11fe504 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:52:05.608182 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-df122c77-b0ba-436c-876d-152fe11fe504 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:52:05.609310 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-df122c77-b0ba-436c-876d-152fe11fe504 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Acquiring lock "6567d965-9880-4701-afff-5a3d599c8537" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 02:52:05.610103 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-df122c77-b0ba-436c-876d-152fe11fe504 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 02:52:05.610834 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG oslo_concurrency.lockutils [None req-df122c77-b0ba-436c-876d-152fe11fe504 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Lock "6567d965-9880-4701-afff-5a3d599c8537" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 02:52:05.626009 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.wsgi [None req-df122c77-b0ba-436c-876d-152fe11fe504 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] HTTP exception thrown: Instance 54461aa4-0a89-4a9c-930b-8c6b84e4d24f could not be found. Aug 09 02:52:05.627706 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-df122c77-b0ba-436c-876d-152fe11fe504 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Request method failure captured: Aug 09 02:52:05.627706 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: request: GET /compute/v2.1/servers/54461aa4-0a89-4a9c-930b-8c6b84e4d24f HTTP/1.1 Aug 09 02:52:05.627706 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Accept: application/json Aug 09 02:52:05.627706 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Accept-Encoding: identity Aug 09 02:52:05.627706 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Connection: close Aug 09 02:52:05.627706 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Content-Length: 0 Aug 09 02:52:05.627706 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Content-Type: application/json Aug 09 02:52:05.627706 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Host: 10.222.0.20 Aug 09 02:52:05.627706 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Openstack-System-Scope: None Aug 09 02:52:05.627706 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: User-Agent: python-urllib3/1.26.11 Aug 09 02:52:05.627706 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Auth-Token: gAAAAABi8ctub6jQA90e7USkvqGYy2-S-eUxFI9WqMmNPzrvSkMvG7G1FZtBk_1HRJk7mdP_Ihm8k-FvDj67eWnKeD_ZvFj7l4XomTXYcNoRM9QrB28Qp_FYHlVtv62XYZy6N5aPXgakBBleBNfCU95zZ9b0DfMYqSDQS-SHO8psTWuFngAHWPE Aug 09 02:52:05.627706 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Domain-Id: None Aug 09 02:52:05.627706 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Domain-Name: None Aug 09 02:52:05.627706 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Identity-Status: Confirmed Aug 09 02:52:05.627706 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Is-Admin-Project: True Aug 09 02:52:05.627706 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Domain-Id: default Aug 09 02:52:05.627706 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Domain-Name: Default Aug 09 02:52:05.627706 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Id: d488e2c8749640a0b3a9b0037051ff12 Aug 09 02:52:05.627706 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Project-Name: tempest-VolumesSnapshotTestJSON-851994339 Aug 09 02:52:05.627706 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Role: reader,member Aug 09 02:52:05.627706 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Roles: reader,member Aug 09 02:52:05.629572 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d488e2c8749640a0b3a9b0037051ff12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d488e2c8749640a0b3a9b0037051ff12"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d488e2c8749640a0b3a9b0037051ff12"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d488e2c8749640a0b3a9b0037051ff12"}]}] Aug 09 02:52:05.629572 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant: tempest-VolumesSnapshotTestJSON-851994339 Aug 09 02:52:05.629572 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant-Id: d488e2c8749640a0b3a9b0037051ff12 Aug 09 02:52:05.629572 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-851994339 Aug 09 02:52:05.629572 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User: tempest-VolumesSnapshotTestJSON-851994339-project Aug 09 02:52:05.629572 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Domain-Id: default Aug 09 02:52:05.629572 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Domain-Name: Default Aug 09 02:52:05.629572 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Id: 9e5f6c1a1f07409483d732db05256f1b Aug 09 02:52:05.629572 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: X-User-Name: tempest-VolumesSnapshotTestJSON-851994339-project Aug 09 02:52:05.629572 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: method: > Aug 09 02:52:05.629572 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: exception: Instance 54461aa4-0a89-4a9c-930b-8c6b84e4d24f could not be found. Aug 09 02:52:05.629572 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: action_args: {'id': '54461aa4-0a89-4a9c-930b-8c6b84e4d24f'} Aug 09 02:52:05.630724 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: {{(pid=124427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 02:52:05.630724 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:52:05.630724 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 02:52:05.630724 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 02:52:05.630724 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 02:52:05.630724 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 02:52:05.630724 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 02:52:05.630724 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 02:52:05.630724 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 02:52:05.630724 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 02:52:05.630724 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54461aa4-0a89-4a9c-930b-8c6b84e4d24f could not be found. Aug 09 02:52:05.630724 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:52:05.630724 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:52:05.630724 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:52:05.630724 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:52:05.630724 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:52:05.630724 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:52:05.630724 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 02:52:05.630724 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 02:52:05.630724 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 02:52:05.632428 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 02:52:05.632428 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 02:52:05.632428 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 02:52:05.632428 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 02:52:05.632428 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 02:52:05.632428 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 02:52:05.632428 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 02:52:05.632428 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54461aa4-0a89-4a9c-930b-8c6b84e4d24f could not be found. Aug 09 02:52:05.632428 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:52:05.632428 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 02:52:05.632428 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:52:05.632428 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 02:52:05.632428 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 02:52:05.632428 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 02:52:05.632428 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 02:52:05.632428 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 02:52:05.632428 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54461aa4-0a89-4a9c-930b-8c6b84e4d24f could not be found. Aug 09 02:52:05.632428 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: ERROR nova.api.openstack.wsgi Aug 09 02:52:05.633852 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: DEBUG nova.api.openstack.wsgi [None req-df122c77-b0ba-436c-876d-152fe11fe504 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] Returning 404 to user: Instance 54461aa4-0a89-4a9c-930b-8c6b84e4d24f could not be found. {{(pid=124427) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 02:52:05.633852 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO nova.api.openstack.requestlog [None req-df122c77-b0ba-436c-876d-152fe11fe504 tempest-VolumesSnapshotTestJSON-851994339 tempest-VolumesSnapshotTestJSON-851994339-project] 10.222.0.20 "GET /compute/v2.1/servers/54461aa4-0a89-4a9c-930b-8c6b84e4d24f" status: 404 len: 111 microversion: 2.1 time: 0.042504 Aug 09 02:52:05.633852 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: [pid: 124427|app: 0|req: 572/1115] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 9 02:52:05 2022] GET /compute/v2.1/servers/54461aa4-0a89-4a9c-930b-8c6b84e4d24f => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 02:52:17.182772 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 02:52:17.184017 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Tue Aug 9 02:52:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 02:54:06.273192 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 02:54:06.273905 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Tue Aug 9 02:54:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 02:55:30.390554 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 02:55:30.391535 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Tue Aug 9 02:55:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 02:55:37.197019 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 02:55:37.197996 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Tue Aug 9 02:55:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 02:55:49.133140 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 02:55:49.134078 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Tue Aug 9 02:55:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 02:57:26.284459 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 02:57:26.285478 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Tue Aug 9 02:57:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 02:57:30.336585 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 02:57:30.337590 dv-cinder-852461-1-iscsi devstack@n-api.service[124425]: Tue Aug 9 02:57:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 02:57:39.827088 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 02:57:39.828082 dv-cinder-852461-1-iscsi devstack@n-api.service[124427]: Tue Aug 9 02:57:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!